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Appendix A. About the study 

This appendix presents additional information about the study topic: teachers’ data use. It begins with a 
description of the conceptual framework and supporting literature for the scales in the Teacher Data Use Survey 
(TDUS; Wayman et al., 2016), which the Nebraska Department of Education (NDE) administered to teachers and 
principals in March 2019. It then presents literature on teacher and school characteristics that were of interest to 
NDE as possible factors associated with teachers’ data use. 


The Teacher Data Use Survey conceptual framework and supporting literature 

This study employed the TDUS as a measure of teachers’ use of summative, interim, and formative assessment 
data. The TDUS is supported by a conceptual framework with relevant literature (Wayman et al., 2016). The 
conceptual framework presents the actions that teachers take with data as critical to improving their knowledge 
and practice and, in turn, students’ learning (figure A1). This framework also articulates that these actions are 
influenced by teachers’ perceived competence in using data, their attitudes toward data, organizational supports, 
and collaboration (Goertz et al., 2009; Supovitz, 2010). Accordingly, the TDUS consists of five scales to measure 
the construct of teachers’ data use: Actions with Data, Competence in Using Data, Attitudes toward Data, 
Organizational Supports, and Collaboration. 
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Figure A1. Teacher Data Use Survey conceptual framework 


Make = y Evaluate 


decisions problems 
i Actions \ 
Synthesize Form 


<a questions 
~ Examine A 


data 


Source: Wayman et al., 2016. 


The study focused on teachers’ use of data, their perceived competence in using data, their attitudes toward data, 
and their perceptions of organizational supports for using data, as measured by the corresponding scales of the 
TDUS. Teacher instructional knowledge and practice and student learning—the other components of the 
conceptual framework—are broader issues that encompass more than just data use and were therefore beyond 
the scope of this study. Accordingly, the TDUS measures only data use and not those two components. In addition, 
the TDUS was not administered with the Collaboration scale because NDE leaders did not deem it a priority and 
were concerned about survey burden and length. By omitting the Collaboration scale, NDE leaders reduced the 
survey length by 16 items. 


Actions with Data scale. Inthe TDUS conceptual framework, teachers are viewed as engaging in a variety of actions 
that help them draw meaning from data. Most of the actions that teachers take when using data involve their 
classrooms. For example, teachers might use data to identify students who need further assistance, select 
instructional materials, or help students understand their learning (Hamilton et al., 2009; Supovitz, 2012). 
Teachers commonly use data to plan which materials to use in classes, group students, tailor individual instruction, 
identify additional instructional supports, or simply decide what to teach (Datnow et al., 2007; Lachat & Smith, 
2005; Supovitz, 2012). Teachers also use data outside the classroom. For instance, teachers might use data to 
facilitate conversations with students, parents, instructional support staff, or other teachers (Datnow et al., 2007; 
Hamilton et al., 2009). 


Additionally, in the TDUS conceptual framework, teachers’ processes as they engage with data are guided by a 
cycle of inquiry. Data are examined in response to problems and questions, and the resulting meaning informs 
decisions (Mandinach & Gummer, 2016a, 2016b). These actions are the driving force behind changes in knowledge 
and practice; that is, teachers are seen as gaining new knowledge through the effective use of data and using that 
knowledge to improve their teaching practice. Teachers use data effectively when they align the appropriate type 
of data to the kinds of decisions they need to make, such as using formative data to gather ongoing, diagnostic 
information to assess student learning that will inform instructional strategies and using summative data to 
periodically inform student progress toward end-of-year benchmarks and grade-level goals (Horn et al., 2015; 
Marsh & Farrell, 2015; Pellegrino et al., 2016). Increased instructional knowledge and improved instructional 
practice thus are expected to translate into improved student learning (Boudett et al., 2005; Lai et al., 2009; 
Mandinach & Gummer, 2016a, 2016b; Slavin et al., 2013). However, outcomes might vary by content area, such 
as math versus reading, and student ability, such low- versus high-achieving students (Carlson et al., 2011; 
Konstantopoulos et al., 2013). In addition, teachers’ perceived competence with data, their attitudes toward data, 
and the organizational supports available to them in using data could influence their data use. 


The Actions with Data scale in the TDUS measures specific actions teachers take with summative, interim, and 
formative assessment data. There are three blocks of the same items that differ only in their reference to using 
summative, interim, or formative data. The items within each block prompt respondents to indicate their 
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frequency of using summative, interim, or formative data to take a variety of actions such as tailoring instruction 
to individual students’ needs, discussing data with students or parents, and meeting with other teachers about 
the data. On the principal version of the TDUS, principals indicate how often their teachers take these actions with 
data. (See appendix E for the teacher and principal versions of the TDUS.) 


Competence in Using Data scale. Educators must be competent in using data in order to engage in effective actions 
with data (Goertz et al., 2009; Mandinach & Gummer, 2013). Without a certain level of competence, educators 
would not be able to engage effectively in examining data or determining information as described in the cycle of 
inquiry (Mandinach & Gummer, 2016a, 2016b). Competence is reciprocally related to teachers’ data use; that is, 
teachers must be competent to use data effectively, and the more they use data effectively, the more their 
competence in using data increases. Educators report that the more they engage in effective data use, the more 
data skills they learn (Lachat & Smith, 2005). To this end, organizational supports are particularly important 
(Hamilton et al., 2009). A variety of such supports have been associated with gaining competence, including data- 
related professional learning (Jimerson & Wayman, 2015; Mandinach & Jimerson, 2016; Wilkerson & Johnson, 
2017), data coaches (Marsh et al., 2010), and effective principal leadership (Copland, 2003; Hamilton et al., 2009). 


The Competence in Using Data scale in the TDUS includes items that prompt teachers to consider whether they 
are proficient in various aspects of data use. Example items include “I am good at using data to diagnose student 
learning needs” and “I am good at adjusting instruction based on data.” The responses provide insight into how 
teachers perceive their competence in using data relative to the actions they take with data. On the principal 
version of the TDUS, these items are framed from a principal’s perspective: “My teachers are good at using data 
to diagnose student learning needs” and “My teachers are good at adjusting instruction based on data.” 


Attitudes toward Data scale. Teachers’ data use could be influenced by their attitudes toward, as well as their 
competence in, using data. Teachers’ attitudes about whether and how data are effectively used to support 
instruction can influence the specific actions they take with data and the depth to which they will engage in these 
actions (Goertz et al., 2009; Supovitz, 2010). In contexts with exemplary data use, teachers have commonly had 
positive attitudes about how data can improve pedagogy and support instructional practice (Datnow et al., 2007; 
Lachat & Smith, 2005). Conversely, in contexts in which data use was difficult, teachers have been skeptical of the 
value of data to their practice (Ingram et al., 2004; Valli & Buese, 2007). 


The Attitudes toward Data scale in the TDUS includes two subscales: Attitudes toward Data and Data’s 
Effectiveness for Pedagogy. The Attitudes toward Data subscale includes items such as “I think it is important to 
use data to inform education practice” and “I like to use data.” The Data’s Effectiveness for Pedagogy subscale 
includes items such as “Data help teachers plan instruction” and “Students benefit when teacher instruction is 
informed by data.” Both the principal and teacher versions of the TDUS have the same phrasing for these items. 


Organizational Supports scale. Teachers’ data use could be influenced by a variety of organizational supports 
implemented at the school, district, regional, or state level (Datnow et al., 2007; Supovitz, 2010; Wayman et al., 
2012). Organizational supports may include computer systems, professional learning, and principal leadership. 


Computer systems enable teachers to access data. Teachers are more likely to use systems that closely align with 
their own views of what data are and how data support learning (Cho & Wayman, 2014). Accordingly, research 
has reported widespread use of a variety of data in effective systems (Lachat & Smith, 2005), but limited use of 
data in systems not perceived as effective (Wayman et al., 2017). 


Organizational supports also include the professional learning that teachers receive to help them improve their 
data use. Data-related professional learning can be an effective support when it is timely, connected to other 
professional learning, and aligned to teachers’ work (Jimerson & Wayman, 2015; Mandinach & Jackson, 2012; 
Mandinach & Jimerson, 2016; Wilkerson & Johnson, 2017). However, research on the relationship between 
organizational supports and teachers’ data use, teachers’ instructional practices, and student achievement is 
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mixed. Some research has shown that teachers improve their data-use practices when they receive school- or 
district-level support for training on using data (Armstrong & Anthes, 2001; Schildkamp & Kuiper, 2010). Other 
research has shown no impacts (Gleason et al., 2019). 


Principal leadership is also touted as an important support for teachers’ data use (Copland, 2003; Knapp et al., 
2006; Sutherland, 2004; Wayman et al., 2012). Principals are often responsible for facilitating organizational 
supports such as those mentioned above. They can employ a variety of other strategies to support teachers’ data 
use, such as protecting scheduled time for teachers to use data; enabling frequent discussions about data between 
teachers and students, teachers and parents, and teachers and school staff; and periodically meeting with 
collaborative teams (Datnow et al., 2007; Hamilton et al., 2009; Knapp et al., 2006, Wayman et al., 2012). 


The Organizational Supports scale in the TDUS includes three subscales: Computer Data Systems, Support for Data 
Use, and Principal Leadership. The Computer Data Systems subscale includes items about characteristics of 
respondents’ data systems, such as “I have the proper technology to efficiently examine data.” The Support for 
Data Use subscale includes items about support structures for teachers, such as “| am adequately supported in 
the effective use of data.” Finally, the Principal Leadership subscale prompts teachers to respond about actions 
that principals and assistant principals take regarding data. For example, one item is “My principal or assistant 
principal(s) encourages data use as a tool to support effective teaching.” On the principal version of the TDUS, 
these items are framed from a principal’s perspective: “My teachers are adequately supported in the effective use 
of data” and “I encourage data use as a tool to support effective teaching.” 


Supporting literature for other factors of interest 


In addition to examining the actions teachers take with data, their perceived competence in using data, their 
attitudes toward data, and their perceptions of organizational supports for using data, this study examined how 
other factors of interest to NDE were associated with teachers’ data use. These factors included teacher 
characteristics such as highest degree earned, years of experience in education, and teaching assignment in a core 
subject, as well as school characteristics such as Nebraska’s school accountability classification. 


Teacher characteristics and data use. Teachers’ education level could account for differences in their own data 
use. Teachers with a more-advanced degree could have received more preparation related to data, such as in 
what the different types of data are, how to collect and interpret data, and how to use data to inform instructional 
decisions (van Geel et al., 2017). Teachers with a more-advanced degree and subsequent understanding of data 
use could value data use and professional support for using data more than teachers with a bachelor’s degree do 
(Moore & Shaw, 2017). However, education programs do not guarantee a foundation in using data because 
teacher preparation programs tend to focus more on assessment literacy than on data literacy (Mandinach et al., 
2015). The limited research on the relationship between education degree and data use (Moore & Shaw, 2017) 
has found mixed results. One study found no relationship between teachers’ degree level and their collaboration 
when reviewing assessments (Ronfeldt et al., 2015). Another study found that teachers enrolled in postsecondary 
degree programs that included instruction on data use were more likely to use data in their classrooms (Reeves 
et al., 2016). 


Teachers’ years of experience in education could also be an important characteristic when examining teachers’ 
data use because more experienced teachers might not have an education background in data use, which is a 
newer focus in the field (Reeves, 2017). Although the relationship between years of experience in education and 
data use has not been studied to a great extent, some research has shown that less experience in education is 
related to higher data use (Reeves, 2017; Yoon, 2016). This finding could be a result of teacher preparation 
programs increasingly integrating data use and data literacy into their curricula to equip new teachers with the 
knowledge and skills necessary to use data to inform instructional decisionmaking (Mandinach & Gummer, 
2016b). Newer teachers might report more frequent data use or positive attitudes toward data than teachers with 
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more years in education do. However, other studies have found that teachers with more experience (for example, 
more than 15 years) engage in data use more often than teachers with less experience do (Means et al., 2007; 
Ronfeldt et al., 2015). Thus, findings from extant research remain mixed. 


Other teacher characteristics might also be factors in understanding teacher data use practices. One study showed 
a notable difference between special education teachers and classroom teachers: special education teachers used 
data more often than their counterparts (Reeves, 2017). Additionally, findings have shown that teachers’ data use 
can vary by content area and subject taught (Means et al., 2007; Zhang & Burry-Stock, 2003). The variations in 
existing research on these topic points to why NDE is interested in examining whether teachers’ data use varies 
based on teacher characteristics. 


School characteristics and data use. The study team did not find existing research on the relationship between 
school accountability classifications—such as NDE's excellent, great, good, and needs improvement classifications, 
which are based on school-level performance data—and teacher data use. Research on teachers’ data use in 
high- versus low-performing schools suggests that teachers in low-performing schools need more professional 
support in using data (Gallagher et al., 2008). Low-performing schools might focus data use on improving 
achievement for targeted student groups, whereas high-performing schools might have the support and resources 
for using data to improve achievement for all students (Spillane et al., 2004). Research also suggests that low- 
performing schools focus data use on monitoring student progress toward benchmarks in math and reading or 
specifically on assisting students at the threshold of passing an assessment (those students most likely to affect a 
school’s accountability rating), in contrast to high-performing schools, which focus data use and improvement 
efforts on all grade levels and content areas (Booher-Jennings, 2005; Spillane et al., 2004). 


Previous research has suggested that teachers’ data use might vary by school level (elementary, middle, or high).? 
For example, one study found that 81 percent of middle and high school science teachers and 77 percent of middle 
and high school English language arts teachers were more likely to use student data systems to keep parents 
informed of students’ progress, compared with 63 percent of elementary school teachers (Gallagher et al., 2008). 
The same study also found that 47 percent of elementary school teachers used student data systems to inform 
instructional pacing, compared with only 31 percent of middle and high school social studies teachers. Another 
study found that elementary and middle school teachers reported using data to inform their instruction more 
often than high school teachers did and that elementary and middle school teachers’ attitudes toward data were 
more positive than those of high school teachers (Moore & Shaw, 2017). 


No studies have explicitly examined the relationship between teachers’ data use and Title | status, in which schools 
receive funding to provide additional support to students from low-income households. According to a national 
study of Title | assistance programs, 40 percent of schools used Title | staff to provide schoolwide data and analytic 


1 This process starts with assigning a school an initial classification level (from 1 to 4) by comparing the percentage of students who score 
on track or higher on the Nebraska Student-Centered Assessment System (NSCAS) Summative math and English language arts statewide 
assessments to established cutscores. The following steps involve adjusting the classification level based on several weighted indicators of 
school performance (for example, graduation rates, the trend of NSCAS Summative math and English language arts assessment scores over 
the prior three years, the percentage of individual assessments scores that showed an increase from the previous year) into one score for 
each school. Each score is compared with the cutscores to adjust the classification level up or down. Once complete, each school is then 
assigned a raw classification score. This raw classification is considered the final classification level unless a school whose level is below 
excellent chooses to submit additional documents for review (for example, policies, procedures, and practices that might impact students’ 
achievement and their outcomes). Following this review, each school receives an additional response score that ranges from O to 120 
points. If the response score is in the top percentile compared with schools in the same raw classification level, a school’s final classification 
level can be raised by one level (Nebraska Department of Education, 2019). 

2 School level (elementary, middle, and high) was used in this study for sampling purposes, in the nonresponse bias analyses, and to account 
for differences in the study’s analytical models. 
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support (Le Floch et al., 2018), perhaps creating a different context for data use in schools receiving Title | funding 
from that in schools not receiving such funding.? 
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Appendix B. Methods 


This appendix provides additional details about the study sample, data, and methods used to conduct the study. 


Selection of schools to include in the study sample 


The Nebraska Department of Education (NDE) used a disproportionate sampling approach to identify schools to 
include in the study. Specifically, NDE constructed a sampling matrix defined by school level (elementary, middle, 
or high school) and Nebraska school accountability classification (excellent, great, good, needs improvement; 
table B1). The matrix included 12 groups of schools, one for each combination of school level and school 
accountability classification. NDE selected this approach because of the different summative assessments 
available for each school level and smaller population sizes for schools classified as excellent and needs 
improvement. NDE randomly selected 30 schools from each of the 12 groups of schools. After selecting the 
sample, NDE learned that seven of the selected schools had closed. Thus, the final sample for the study included 
28-30 schools from each group, for a total of 353 schools. 


Table B1. Study sampling matrix with the counts of schools in Nebraska and in the study sample, 2018/19 
moje] malvlanle\-1meyi 


Elementary schools {Ke Ke] CMe) aYere) [5 High schools EXol aToye) 

NYol ato) -laxelUlaie-loli iia 

classification Nebraska Sample Nebraska Sample Nebraska Sample Nebraska Sample 
Needs improvement 74 30 44 29 38 30 156 89 
Good 196 30 105 30 88 30 389 90 
Great 217 28 113 29 101 30 431 87 
Excellent 58 30 39 28 37 29 134 87 
ileal ek 545 118 301 116 264 119 1,110 353 


Source: Administrative data provided by Nebraska Department of Education, 2018/19. 


Survey administration 

Using an online survey platform, NDE administered the Teacher Data Use Survey (TDUS) in March 2019, during a 
time that did not conflict with other state survey campaigns. In the survey invitation NDE encouraged principals 
to allocate time for teachers to complete the survey. NDE sent three follow-up reminders to survey recipients. To 
address common challenges with self-reported data, NDE sent recipients a letter from the Nebraska commissioner 
of education stating that results would be used to plan ongoing professional learning support for data use and not 
for accountability purposes. NDE also sent an informed consent form that assured recipients that their identities 
and confidentiality would be protected. To promote memory recall and minimize the time between assessment 
use and survey completion, NDE administered the survey during the middle of the 2018/19 school year, when 
teachers would have had the opportunity to use data from all three forms of assessments (summative, interim, 
and formative) at least once. The survey questions prompted respondents to focus only on their use of these data 
during the 2018/19 school year. 


Analytic sample characteristics and nonresponse bias analyses 

The study team constructed an analytic sample for each survey version (teacher and principal) that included only 
respondents who had nonmissing data on all survey items needed to answer all of the study research questions. 
Data were considered nonmissing if respondents provided a valid answer or if their answer was logically missing. 
For example, if teachers indicated that a particular assessment was not available to them on survey question 1, 
they were not asked about their use of that assessment, resulting in logically missing data. 
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Total response rates for both survey versions fell below the 85 percent threshold specified in National Center for 
Education Evaluation and Regional Assistance (NCEE, 2019) guidance. For the teacher version of the TDUS, the 
analytic sample included 3,572 respondents, which was a 34.5 percent response rate. For the principal version of 
the survey, the analytic sample included 171 respondents, which was a 48.4 percent response rate. 


The study team conducted a nonresponse bias analysis to determine the extent to which respondents differed 
from the original sample on key characteristics. The original sample included all survey recipients. Means and 
standard deviations were calculated for each characteristic for the original sample and for the analytic sample. 
Next, the mean difference between the original sample and the analytic sample for each variable was calculated. 
This mean difference was divided by the standard deviation for the original sample. According to NCEE (2019) 
guidance, any differences greater than 0.05 standard deviation should be accounted for in the analyses. 


The study team examined a variety of key characteristics that were available in the NDE administrative datasets 
(table B2). These variables were available for every educator who was included in the original sample. For both 
the teacher and principal versions of the TDUS, three characteristics of the schools in which the educator worked 
were examined: school level (elementary, middle, or high), school accountability classification (excellent, great, 
good, or needs improvement), and Title | status. In addition, for the teacher version four personal characteristics 
were examined: highest degree earned (lower than a bachelor’s, bachelor’s, master’s, or more-advanced degree); 
special education endorsement or no special education endorsement; full-time equivalency; years of experience 
in education; and an indicator as to whether the teacher taught a core subject. For the principal version full-time 
equivalency was the only personal characteristic examined. Prior to the nonresponse calculations dummy 
variables were created for all the categorical variables. 
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Table B2. Key characteristics used for nonresponse bias analyses 


NV ETar-le)(<Mar-lani-) Description 


Highest degree earned Teachers were divided into four categories based on their highest degree earned: lower 
than a bachelor’s degree (for example, a certificate), bachelor’s degree, master’s 
degree, or more-advanced degree (education specialist or doctoral degree). 


Special education endorsement Teachers were divided into two categories based on whether they had a special 
education endorsement. 
Core subject teacher Teachers were considered to be teaching a core subject if they taught general 


elementary, English language arts, math, science, or history/social studies. Teachers 
were considered to be teaching a noncore subject if they taught other subjects such as 
fine arts, health/physical education, foreign language, intervention, technology, or 
response to intervention. 

Years of experience in education Teachers’ years of experience in education were included as a continuous variable for 
the nonresponse bias analyses. To aid in interpretation for the analyses to answer the 
research questions, teachers were divided into four categories: 5 or fewer years, 6-12 
years, 13-21 years, or 22 or more years. The categories were established by dividing the 
data points for years of experience in education into quartiles. 


Teacher full-time equivalency Teachers’ full-time equivalency is a ratio of their teaching load compared with a full- 
time teacher’s load. Thus, a 1 would indicate a full-time teaching load. 

Principal full-time equivalency Principals’ full-time equivalency is a ratio of their principal administrative load 
compared with a full-time principal’s load. Thus, a 1 would indicate a full-time load. 

School level Schools were divided into three categories based on the grade levels they served 


(elementary, middle, or high school). 

School accountability classifications By considering multiple indicators of school performance, the Nebraska Department of 
Education (2018a) classifies each Nebraska school into one of four classification levels: 
excellent, great, good, and needs improvement. These indicators include statewide 
math and English language arts assessment scores and trends, graduation rates, student 
absenteeism rates, and English learner student progress toward proficiency. This 
classification system is used to strategically target resources and support to schools 
most in need of improvement. 

Title | school Schools were divided into two categories based on whether they had Title | status. A 
Title | school receives federal funds under Title |, Part A, of the Every Student Succeeds 
Act. Title | funds are intended to assist schools with high concentrations of students 
from low-income households.? 


a. See https://www2.ed.gov/programs/titleiparta/index.html. 
Source: Authors’ creation. 


The nonresponse bias analyses for teachers indicated that the analytic sample differed from the original sample 
by more than 0.05 standard deviation for three characteristics (table B3). A smaller proportion of teachers in the 
analytic sample (41 percent) than in the original sample (44 percent) worked in high schools. A larger proportion 
of teachers in the analytic sample (24 percent) than in the original sample (21 percent) had a special education 
endorsement. Finally, on average, teachers in the analytic sample had more experience working in education 
(14.93 years) than did teachers in the original sample (14.07 years). 
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Table B3. Comparison of original teacher sample and teacher analytic sample on key characteristics, 2019 


Original sample (n = 10,349) Analytic sample (n = 3,572) Difference in 
S\ilaler-lae| S\ilalerlae| standard 

Characteristic Mean deviation Mean deviation deviation units 
School level 

Elementary 0.28 0.45 0.29 0.45 -0.02 

Middle 0.29 0.45 0.31 0.46 —-0.04 

High 0.44 0.50 0.41 0.49 0.06 
School accountability classification 

Needs improvement 0.31 0.46 0.31 0.46 0.00 

Good 0.26 0.44 0.26 0.44 —0.01? 

Great 0.24 0.42 0.23 0.42 0.02 

Excellent 0.19 0.40 0.20 0.40 —0.02 
Title | school 0.33 0.47 0.35 0.48 —0.03 
Teacher’s highest degree earned 

Lower than bachelor’s degree 0.00 0.05 0.00 0.06 —0.02 

Bachelor’s degree 0.44 0.50 0.42 0.49 0.04 

Master’s degree 0.55 0.50 0.57 0.50 —-0.04 

More-advanced degree 0.01 0.09 0.01 0.09 0.00 
eee : Speblel eaucetian 0.21 0.41 0.24 0.43 ~0.07 
Teacher full-time equivalency 0.91 0.22 0.91 0.22 0.00 
Years of experience in education 14.07 10.25 14.93 10.54 -0.08 
Teacher teaches a core subject 0.45 0.50 0.46 0.50 —0.02 


a. When rounded to two decimal places, the difference between the means for the original sample and analytic sample appeared to be zero. However, the 
means were not, in fact, identical, resulting in a nonzero value for the difference in standard deviation units. 

b. An education specialist or doctoral degree. 

Source: Authors’ analysis of 2019 administrative data from the Nebraska Department of Education. 


The nonresponse bias analyses for principals indicated that the analytic sample differed from the original sample 
by more than 0.05 standard deviation for just one characteristic: Title | school (table B4). A greater proportion of 
principals in the analytic sample (38 percent) worked in Title | schools than in the original sample (34 percent). 


Table B4. Comparison of original principal sample and principal analytic sample on key characteristics, 2019 


Original sample (n = 353) Analytic sample (n = 171) Difference in 
S\ilaler-lae| S\i-laler-lae| standard 

Characteristic Mean deviation Mean deviation deviation units 
School level 

Elementary 0.33 0.47 0.33 0.47 0.01? 

Middle 0.33 0.47 0.33 0.47 —0.01? 

High 0.34 0.47 0.34 0.47 0.00 
School accountability classification 

Needs improvement 0.25 0.43 0.25 0.43 0.01? 

Good 0.25 0.44 0.27 0.45 -0.05 

Great 0.25 0.43 0.24 0.43 0.02 

Excellent 0.25 0.43 0.24 0.43 0.02 
Title | school 0.34 0.48 0.38 0.49 —0.08 
Principal full-time equivalency 0.83 0.26 0.82 0.26 0.04 


a. When rounded to two decimal places, the difference between the means for the original sample and analytic sample appeared to be zero. However, the 
means were not, in fact, identical, resulting in a nonzero value for the difference in standard deviation units. 
Source: Authors’ analysis of 2019 administrative data from the Nebraska Department of Education. 
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Calculation of nonresponse weights 
To account for the differences between the original sample and the analytic sample, nonresponse weights were 
calculated. These weights were subsequently used in the analyses to adjust the analytic sample data so that the 
data more closely resembled the original sample. The methods used to calculate the weights are described here, 
first for teachers and then for principals. 


Calculation of nonresponse weights for the teacher sample. Logistic regression was used to calculate nonresponse 
weights for the teacher sample. Using data from all teachers in the original sample, the study team fit a logistic 
regression model that included a binary indicator of whether a teacher was in the analytic sample as the 
dependent variable. This variable was coded 1 if the teacher was in the analytic sample and 0 if the teacher was 
not. The model included the three independent variables for which the difference between the original sample 
and the analytic sample was greater than 0.05 standard deviation: high school, special education endorsement, 
and years of experience. 


Using the results from the logistic regression, the study team calculated the predicted probability of response for 
each member of the original sample. The inverse of the predicted probability for each case multiplied by the 
overall response rate was used as the weight. The means and standard deviations for each of the key variables for 
the original sample, alongside the weighted means and standard deviations for the analytic sample, are in table 
BS. This table demonstrates that, once the weights were applied, there were no differences greater than 0.05 
standard deviation between the original sample and the analytic sample on key characteristics. 


Table B5. Comparison of original teacher sample and weighted teacher analytic sample on key characteristics, 
2019 


Original sample (n = 10,349) Analytic sample (n = 3,572) Difference in 
S\ilalerlae| S\ilalerlae| standard 

Characteristic Mean deviation Mean deviation deviation units 
School level 

Elementary 0.28 0.45 0.27 0.45 0.01 

Middle 0.29 0.45 0.29 0.45 —0.013 

High 0.44 0.50 0.43 0.50 0.00 
School accountability classification 

Needs improvement 0.31 0.46 0.31 0.46 —-0.01? 

Good 0.26 0.44 0.26 0.44 —0.01 

Great 0.24 0.42 0.23 0.42 0.03 

Excellent 0.19 0.40 0.20 0.40 -0.01 
Title | school 0.33 0.47 0.34 0.47 —0.02 
Teacher’s highest degree earned 

Lower than bachelor’s degree 0.00 0.05 0.00 0.06 -0.04° 

Bachelor’s degree 0.44 0.50 0.43 0.50 0.02 

Master's degree 0.55 0.50 0.56 0.50 -0.01 

More-advanced degree 0.01 0.09 0.01 0.09 0.00 
ciate : sercsuecuete 0.21 0.41 0.22 0.41 0.00 
Teacher full-time equivalency 0.91 0.22 0.91 0.22 -0.01° 
Years of experience in education 14.07 10.25 14.10 10.26 0.00 
Teaches a core subject 0.45 0.50 0.47 0.50 -0.04 


a. When rounded to two decimal places, the difference between the means for the original sample and analytic sample appeared to be zero. However, the 
means were not, in fact, identical, resulting in a nonzero value for the difference in standard deviation units. 

b. An education specialist or doctoral degree. 

Source: Authors’ analysis of 2019 administrative data from the Nebraska Department of Education. 
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Calculation of nonresponse weights for the principal sample. Logistic regression was also used to calculate 
nonresponse weights for principals. The calculation of weights for principals, however, was not as straightforward. 
The study team found that weighting to adjust for one variable led the weighted analytic sample to differ from 
the original sample by more than 0.05 standard deviation on additional variables. An iterative process was 
followed in which additional logistic regressions were fit, including any new variables with differences greater than 
0.05 standard deviation as predictors; new weights were calculated; and nonresponse bias analyses were 
repeated. The details of this iterative process are described here. 


Because the original sample and analytic sample differed by more than 0.05 standard deviation on just one 
variable, Title | status, this was the only independent variable in the model. Weights were calculated using the 
procedure previously described for the teacher sample. When the descriptive statistics for the key characteristics 
for the weighted sample were compared with the original sample, the two samples were similar in terms of Title 
| status (both 34 percent), but the two samples differed by more than 0.05 standard deviation for elementary 
school level. 


The study team fit a second logistic regression model that included Title | status, elementary school level, and the 
interaction between them. A second set of weights was calculated using the results of this model, and the 
weighted descriptive statistics for the key characteristics for the analytic sample were again compared with the 
original sample. The result was a weighted analytic sample that was similar to the original sample in terms of 
elementary school level (both 33 percent) and Title | (both 34 percent) but differed from the original sample by 
more than 0.05 standard deviation on the good accountability classification. 


The study team fit a third logistic regression model with the following independent variables: Title | status, 
elementary school level, and good accountability classification, along with all of the interactions between them. 
A third set of weights was calculated, which resulted in a weighted analytic sample that was similar to the original 
sample in terms of Title | status (both 34 percent), elementary school level (both 33 percent), and good 
accountability classification (both 26 percent). However, this weighted analytic sample differed from the original 
sample by more than 0.05 standard deviation on principal full-time equivalency. 


The study team then fit a fourth logistic regression model that included Title | status, elementary school level, 
good accountability classification, principal full-time equivalency, and all possible two-way, three-way, and four- 
way interactions. A fourth and final set of weights was calculated. Once the weights were applied, the analytic 
sample did not differ from the original sample on any of the key characteristics by more than 0.05 standard 
deviation (table B6). 
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Table B6. Comparison of original principal sample and weighted principal analytic sample on key 
characteristics, 2019 


Original sample (n = 353) Analytic sample (n = 171) Difference in 
Silale rele] S\ilaler-lae| standard 

Characteristic Mean deviation Mean deviation deviation units 
School level 

Elementary 0.33 0.47 0.33 0.47 0.00 

Middle 0.33 0.47 0.33 0.47 0.01 

High 0.34 0.47 0.34 0.48 —0.01? 
School accountability classification 

Needs improvement 0.25 0.43 0.24 0.43 0.02 

Good 0.26 0.44 0.26 0.44 0.00 

Great 0.25 0.43 0.25 0.43 —0.01? 

Excellent 0.25 0.43 0.25 0.44 —0.02 
Title | school 0.34 0.48 0.34 0.48 0.00? 
Principal full-time equivalency 0.83 0.26 0.83 0.26 0.00 


a. When rounded to two decimal places, the difference between the means for the original sample and analytic sample appeared to be zero. However, the 
means were not, in fact, identical, resulting in a nonzero value for the difference in standard deviation units. 
Source: Authors’ analysis of 2019 administrative data from the Nebraska Department of Education. 


Measures 


The study team examined Nebraska teachers’ and principals’ responses to the TDUS (see appendix E). The TDUS 
allows users to customize the questions to refer to the specific type of assessment data that is most important 
and relevant in their state or local contexts. NDE uses the Nebraska Student-Centered Assessment System 
(NSCAS), which identifies three assessment components to measure what students know and need to learn: the 
NSCAS Summative assessment; the Northwestern Evaluation Association’s MAP Growth interim assessment; and 
formative assessment (table B7). The NSCAS formative assessment component is not part of a centralized data 
warehouse, nor do teachers enter or access formative data as part of any type of statewide system. NDE 
customized the TDUS to include questions about five different summative assessments (NSCAS English language 
arts, NSCAS mathematics, NSCAS science, NSCAS ACT, and English Language Proficiency Assessment for the 21st 
Century [ELPA21]); the state’s interim assessment (MAP Growth); and classroom-based formative assessments. 
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Table B7. Nebraska Department of Education definitions and Teacher Data Use Survey data category for 
summative, interim, and formative assessment types 


Assessment type 
Summative state 


NDE definition 
“Culminating assessments measuring student 


WNDU Wel-lu-We-1n-1-40) a7 
The TDUS refers to the “state” data category as 


assessment performance against state content area standards” including state-level tests and student 
(Nebraska Department of Education, 2018b, p. 2). achievement data (Wayman et al., 2016). This 
Nebraska schools administer the NSCAS summative study uses the NSCAS Summative assessment to 
computer-adaptive assessment to measure math and __ represent the “state” data category. The TDUS 
English language arts content standards and college measures, rather than prescribes or defines, 
readiness. NDE refers to this assessment as “NSCAS how teachers should use student data from the 
Summative” for grades 3-8 and “NSCAS ACT” forhigh — state data category. 
school. 

Interim “Assessments administered at intervals between The TDUS refers to the “periodic” data category 

assessment instruction (typically fall/winter/spring) to help as including commercially available assessments 
teachers better understand student learning needs administered periodically during the school year 
and determine growth toward learning targets” (Wayman et al., 2016). This study refers to the 
(Nebraska Department of Education, 2018b, p. 2). The © NSCAS Interim assessment to represent the 
NSCAS Interim assessment system consists of MAP “periodic” data category. The TDUS measures, 
Growth, which is available to Nebraska districts at no rather than prescribes or defines, how teachers 
cost. The assessment measures “what individual should use student data from the periodic data 
students know and are ready to learn and tracks category. 
growth toward proficiency levels” (Nebraska 
Department of Education, 2018b, p. 2). 

Formative “Formal and informal tools teachers use in the The TDUS refers to the “local” data category as 

assessment classroom to check their students’ understanding and __ including, for example, common formative 


assessments that districts develop. The TDUS 
also refers to the “personal” data category as 
including, for example, teacher-developed 
classroom-based assessments such as tests, 
quizzes, and homework. Both the local and 
personal data categories focus on teachers’ use 
of formative student data, which aligns to NDE’s 
reference to formal and informal tools teachers 
use in the classroom (Wayman et al., 2016). This 
study refers to formative assessments to 
represent the “local” and “personal” data 
categories on the TDUS. The TDUS measures, 
rather than prescribes or defines, how teachers 
should use student data from the local and 
personal data categories. 


then adapt their teaching in the moment to what 
students need” (Nebraska Department of Education, 
2018b, p. 2). NDE refers to this assessment process as 
“formative.” 


NDE is Nebraska Department of Education. NSCAS is Nebraska Student-Centered Assessment System. TDUS is Teacher Data Use Survey. 
Source: Authors’ creation based on definitions in Nebraska Department of Education (2018b) and Wayman et al. (2016). 


The teacher and principal versions of the TDUS contain similar content, but the wording of survey items changes 
to reflect the appropriate respondent roles (teacher or principal). Respondents use a four-point Likert scale to 
respond to each question. The items on the TDUS measure the frequency with which teachers use NSCAS 
Summative, NSCAS Interim, and formative assessment data; the actions teachers take with NSCAS Summative, 
NSCAS Interim, and formative assessment data; perceptions of teachers’ competence in using data; teachers’ 
attitudes toward data use; and the organizational supports available to help teachers use data. 


To address the research questions, the study team analyzed data from the TDUS. Information about each of the 
variables, including the survey items that comprise each scale and the reliability estimates for each scale, is in 
table B8. All of the scales created from survey items had acceptable reliability for both the teacher and principal 
versions. 
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Table B8. Teacher Data Use Survey variables analyzed to address the research questions, 2019 
Cronbach’s alpha coefficients 


Research 


NEVar-lel(=1 question Survey items? Teacher version Principal version 
Frequency of use of NSCAS 
oie pnisee arts ae ee ne ee 
der loenhe use of NSCAS 1,2 2b aa nae 
head of use of NSCAS 1,2 Xc na? Hae 
Frequency of use of NSCAS ACT 1,2 2d na> na? 
Frequency of use of ELPA21 1,2 2e na> na? 
Fr ncy of of MAP Growth 
a wea ve ne 
seed use of formative 1,2 2g ane aa 
Usefulness of summative data 1,2 Mean of 3a—3e na‘ na‘ 
Usefulness of interim data 1,2 3f na? na? 
Usefulness of formative data 1,2 3g na? na? 
Actions with summative data Mean of actions with NSCAS English 

language arts data (4a—4h), actions 

with NSCAS mathematics data (5a— 

as 5h), NSCAS science data een os es 

actions with NSCAS ACT data (7a—7h), 

and actions with ELPA21 data (8a—8h) 
Actions with interim data 1-5 Mean of 9a—9h 94 94 
Actions with formative data 1-5 Mean of 10a—10h 92 92 
Competence in using data 3-5 Mean of 15a—15d 92 91 
Attitudes toward data 3-5 Mean of 12a-12i 88 88 
Organizational supports 3-5 Mean of 11a-11f, 13a—13f, 14a—14e .80 79 


na is not applicable. 

ELPA21 is English Language Proficiency Assessment for the 21st Century. NSCAS is Nebraska Student-Centered Assessment System. 

a. See appendix E for the full text of the teacher and principal versions of the Teacher Data Use Survey. 

b. This construct is measured with a single item. Thus, Cronbach’s alpha cannot be calculated. 

c. The survey included questions about five different types of summative data. Because these summative assessments are administered to students at 
different grade levels, only a very small percentage of teachers had access to all five types of summative data. Similarly, only a small percentage of principals 
worked with teachers who had access to all five types of summative data. Thus, it did not make sense to calculate Cronbach’s alpha for this scale. 

Source: Authors’ creation and analysis based on 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Analyses to address research questions 


The analytic approach for each of the research questions is described in this section. Due to the large sample size, 
the analyses for research questions 3-5 had high statistical power to detect small effects that might be of little 
practical significance. Consequently, discussion of results focused on mean differences between groups that were 
0.25 or larger. For consistency, this threshold was also used for determining results to discuss for research 
questions 1 and 2. 


How do Nebraska teachers report using summative, interim, and formative data to inform practice? To address 
research question 1, the study team calculated descriptive statistics (for example, means, standard deviations, 
frequencies) of TDUS items related to how often teachers use data to inform their instructional practice. 
Specifically, these descriptive analyses summarized the frequency with which teachers use summative, interim, 
and formative assessment data and the actions they take when using each of these assessments to inform 
practice. 


Are Nebraska principals’ attitudes about data and perceptions of teachers’ data use similar to teachers’ reports of 
their own attitudes and data use? Research question 2 examined the responses across the teacher and principal 
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versions of the TDUS on all survey scales. The study team calculated scale means and standard deviations, 
following the TDUS guide (Wayman et al., 2016). The guide suggests that using scale means is appropriate when 
making comparisons across survey scales (actions with data, perceived data competence, attitudes toward data, 
and perceived organizational supports for using data) and survey versions (teacher and principal). Additionally, 
when individual items combine to measure a particular scale (for example, perceived data competence), 
calculating means and standard deviations are an appropriate method (Boone & Boone, 2012; Sullivan & Artino, 
2013). Therefore, the study team calculated and reported means to provide a consistent presentation of results 
that allows readers to make visual comparisons of differences among variables of interest (for example, data type, 
respondent type, and TDUS scale). 


How does teachers’ use of data relate to teachers’ perceived competence in using data, attitudes toward data, and 
perceptions of organizational supports for using data? To address research question 3, the study team fit three 
multilevel models with each of the following dependent variables: actions with summative data; actions with 
interim data; and actions with formative data. At level 1, three independent variables were included: competence 
in using data, organizational supports, and attitudes toward data. In addition, four level-1 covariates were 
included: teacher’s highest degree earned (bachelor’s degree, master’s degree, or more-advanced degree; 
dummy coded), an indicator for whether the teacher had a special education endorsement, teacher's years of 
experience in education (categorized into quartiles: 5 or fewer years, 6-12 years, 13-21 years, or 22 or more 
years;* dummy coded), and an indicator for whether the teacher taught a core subject. All variables included at 
level 1 were group mean-centered (Enders & Tofighi, 2007; Kreft et al., 1995). At level 2, two covariates were 
included: school level (elementary, middle, or high; dummy coded) and Title | status. These variables were grand 
mean-—centered. 


How do teachers’ use of data, perceived competence in using data, attitudes toward data, and perceptions of 
organizational supports for using data vary by teacher characteristic? The study team fit six models to address 
research question 4. The models included each of the following dependent variables: actions with summative 
data, actions with interim data, actions with formative data, competence in using data, attitudes toward data, and 
organizational supports. In these models teacher characteristics served as the independent variables of interest. 
Specifically, at level 1 the following variables were added: teacher’s highest degree earned (bachelor’s degree, 
master’s degree, or more-advanced degree; dummy coded), years in education (categorized into quartiles: 5 or 
fewer years, 6-12 years, 13-21 years, or 22 or more years; dummy coded), an indicator for whether the teacher 
had a special education endorsement, and an indicator for whether the teacher taught a core subject. All variables 
included at level 1 were group mean-—centered. At level 2, two covariates were included: school level (elementary, 
middle, or high; dummy coded) and Title | status. These variables were grand mean—centered. 


The study team fit additional models to obtain the coefficients needed to calculate adjusted means for categorical 
predictors. For each characteristic of interest, a model was fit with the dummy variables for that characteristic 
uncentered. For example, a model was fit with the dummy variables for education uncentered but all other 
variables centered. The results of this model were used to calculate adjusted means for education levels. In this 
model bachelor’s degree was the reference category, so the intercept for the model was equal to the adjusted 
mean for that group. Adjusted means for the other two groups (master’s degree and more-advanced degree) 
were calculated by adding the coefficient for each group’s dummy variable to the intercept. This process was 
repeated for each of the other teacher characteristics: years of experience in education, special education 
endorsement, and core subject. 


How do teachers’ use of data, perceived competence in using data, attitudes toward data, and perceptions of 
organizational supports for using data vary based on Nebraska school accountability classifications (that is, 
excellent, great, good, and needs improvement) for the 2018/19 school year? To address research question 5, the 


4 The study team categorized years of experience in education into quartiles to make it easier for readers to interpret the results. 
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study team fit six multilevel models, each with one of the following dependent variables: actions with summative 
data, actions with interim data, actions with formative data, competence in using data, attitudes toward data, and 
organizational supports for using data. These models were similar to the models fit to address research question 
4. The only difference was the addition of school accountability classification as independent variables (excellent, 
great, good, or needs improvement; dummy coded) at level 2. As with the other level-2 variables, these dummy 
variables were grand mean-centered. The study team fit additional models to obtain the coefficients needed to 
calculate adjusted means for school accountability classifications, using the same process as that for research 
question 4. 
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Appendix C. Supporting analysis 

This appendix provides descriptive statistics (for example, numbers of teachers or principals, means, and standard 
deviations) to support findings in the report for research questions 1 and 2 (tables C1—C9). Supporting hierarchical 
linear models for research questions 3—5 are also presented (tables C10—C36). 


Table C1. Percentage of teachers who did not use summative, interim, or formative data and percentage of 
principals who perceived that teachers did not use these data types, 2019 


Teachers atatell ox-1 5 


Data type Number Percent Number Percent 
Did not use data from at least one type of 


: 948 29 11 6 
summative assessment? 
Did not use interim® data 697 21 0 0 
Did not use formative data 187 6 1 1 


Note: For this survey item, respondents could select a response option indicating they did not use (or, on the principal version, perceived that teachers did 
not use) the assessment type. For those who did use the assessment type, respondents could indicate the frequency with which they used, or perceived 
teachers as using (on the principal version), each assessment type (see table C2). 

a. The mean for summative data includes the average across ratings for five different summative assessment types available to Nebraska teachers. The 
summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics (grades 3-8), 
NSCAS science (grades 5 and 8), NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner students). See 
table D2 in appendix D for descriptive results disaggregated by each summative assessment type. 

b. Interim assessment is the MAP Growth interim assessment. 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table C2. Means and standard deviations of teacher self-reported frequency in using summative, interim, and 
formative data and principals’ perceptions of teachers’ frequency in using these data types, 2019 


Teachers raiatell ox-) 5 
Sim-lalel-]ae] Silalel-]ae| 
Data type Number Mean deviation Number Mean deviation 
Frequency of using summative data? 2,268 1.63 0.80 160 1.54 0.70 
Frequency of using interim data? 2,643 1.98 0.91 168 2.22 0.78 
Frequency of using formative data 3,016 3.03 0.91 163 3.08 0.85 


Note: Frequency was measured on a four-point scale in which 1 = less than once a month, 2 = once or twice a month, 3 = weekly or almost weekly, and 4 = 
a few times a week. Respondents could indicate that they did not use a given assessment. The means include only respondents who indicated frequency of 
use on the four-point scale and do not include respondents who indicated they did not use the given data type. 

a. The mean for summative data includes the average across ratings for five different summative assessment types available to Nebraska teachers. The 
summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics (grades 3-8), 
NSCAS science (grades 5 and 8), and NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner students). 
See table D2 in appendix D for descriptive results disaggregated by each summative assessment type. 

b. Interim assessment is the MAP Growth interim assessment. 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table C3. Means and standard deviations of teachers’ and principals’ perceptions of usefulness of summative, 
interim, and formative data, 2019 


Teachers a tarell ex-1 5 


Standard Standard 
Data type Number Mean deviation Number Mean deviation 
oad ereHin ate 3,216 1.83 0.75 171 2.35 0.75 
Usefulness of interim data? 3,340 2.61 1.03 168 3.42 0.66 
Usefulness of formative data 3,203 3.33 0.86 164 3.59 0.62 


Note: Usefulness was measured on a four-point scale in which 1 = not useful, 2 = somewhat useful, 3 = useful, and 4 = very useful. 

a. The summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics (grades 
3-8), NSCAS science (grades 5 and 8), NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner students). 
See table D2 in appendix D for descriptive results disaggregated by each summative assessment type. 

b. Interim assessment is the MAP Growth Interim assessment. 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table C4. Means and standard deviations of teachers’ self-reported actions with summative, interim, and 
formative data and principals’ perceptions of teachers’ actions with these data types, 2019 


Teachers arava ex-1 5 
S\rTaler-lae| S)rTaler-lae| 
Data type Mean deviation Mean deviation 
Actions with summative data? 2,268 1.24 0.38 160 1.24 0.40 
Actions with interim data® 2,643 1.77 0.72 168 2.05 0.65 
Actions formative data 3,016 2.50 0.77 163 2.66 0.67 


Note: Frequency of actions with summative data was measured on a scale in which 1 = one or two times a year, 2 = a few times a year, 3 = monthly, and 4 = 
weekly. Frequency of actions with interim and formative data was measured on a scale in which 1 = less than once a month, 2 = monthly, 3 = weekly, and 4 
=a few times a week. To make comparisons using the same scale, ratings for summative data were recoded to the interim and formative response scale. A 
rating of 4 (weekly) on the summative scale was recoded as a 3 (weekly or almost weekly) on the interim/formative scale, a rating of 3 (monthly) was recoded 
as a 2 (once or twice a month), and a rating of 2 or 1 was recoded as a 1 (less than once a month). 

a. The summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics (grades 
3-8), NSCAS science (grades 5 and 8), NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner students). 
b. Interim assessment is the MAP Growth Interim assessment. 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table C5. Item-level means and standard deviations of teachers’ self-reported actions with summative, 
interim, and formative data, 2019 


Actions with summative data? PNevdolacmy idan iayeelalaame tebe Actions with formative data 
Action with data Number of Standard Number of Standard Number of Siilalel-lae} 
items teachers Mean _ deviation teachers Mean deviation teachers Mean deviation 
To identify 
instructional content 2,268 1.37 0.60 2,643 1.95 0.91 3,016 2.92 0.93 


to use in class. 

To tailor instruction 

to individual 2,268 1.35 0.58 2,643 2.00 0.93 3,016 2.96 0.92 
students’ needs. 

To develop 
recommendations 
for additional 
instructional support. 
To form small groups 
of students for 2,268 1.27 0.50 2,643 1.94 0.95 3,016 2.69 1.02 
targeted instruction. 
To discuss data with 
a parent or guardian. 
To discuss data with 
a student. 

To meet with a 
specialist (e.g., 
instructional coach 2,268 1.13 0.35 2,643 1.53 0.76 3,016 1.76 0.95 
or data coach) about 

data. 

To meet with 

another teacher 2,268 1.24 0.47 2,643 1.75 0.84 3,016 2.31 1.00 
about data. 


2,268 1.31 0.53 2,643 1.99 0.91 3,016 2.88 0.93 


2,268 1.08 0.28 2,643 1.41 0.69 3,016 1.89 0.96 


2,268 1.20 0.44 2,643 1.56 0.77 3,016 2.62 0.96 


Note: Frequency of actions with summative data was measured on a scale in which 1 = one or two times a year, 2 = a few times a year, 3 = monthly, and 4 = 
weekly. Frequency of actions with interim and formative data was measured on a scale in which 1 = less than once a month, 2 = monthly, 3 = weekly, and 4 
=a few times a week. To make comparisons using the same scale, ratings for summative data were recoded to the interim and formative response scale. A 
rating of 4 (weekly) on the summative scale was recoded as a 3 (weekly or almost weekly) on the interim/formative scale, a rating of 3 (monthly) was recoded 
as a 2 (once or twice a month), and a rating of 2 or 1 was recoded as a 1 (less than once a month). See table D6 in appendix D for descriptive results for 
summative data without recoding. 

a. The summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics (grades 
3-8), NSCAS science (grades 5 and 8), NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner students). 
b. Interim assessment is the MAP Growth interim assessment. 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table C6. Means and standard deviations of teachers’ and principals’ perceptions of teachers’ competence in 
using data, attitudes toward data, and perceptions of organizational supports, 2019 


Teachers ra rarell ex-1 5 
Sil alel-]ae| Slilalel-lae] 
Mean deviation Mean deviation 
Competence in Using Data 3,572 2.91 0.56 171 2.86 0.50 
Attitudes toward Data 3,572 3.09 0.51 171 3.43 0.44 
Organizational Supports 3,572 2.95 0.51 171 3.11 0.45 


Note: Scale items were measured on a four-point scale in which 1 = strongly disagree, 2 = disagree, 3 = agree, and 4 = strongly agree. 
Source: Authors’ analyses based on 2019 data from Nebraska Department of Education’s Teacher Data Use Survey data. 


Table C7. Item-level means and standard deviations of teachers’ and principals’ attitudes toward data, 2019 


Teachers aratell ox-15) 
Siclarerlce! Syiclaretlae| Mean 
AYU] ofcYor-] (i= arominsyan Number Mean deviation Number Mean deviation difference 
Data’s Effectiveness for Pedagogy subscale 
Data help teachers plan instruction. 3,572 3.19 0.57 171 3.48 0.55 -0.29 
Data offer information about students 3,568 3.02 0.60 170 3.22 0.58 -0.19 
that was not already known. 
Dale He) pteac tiene eaMewriat 3,568 3.13 0.55 171 3.36 0.54 ~0.23 
concepts students are learning. 
Data help teachers identify learning 3571 3.17 0.56 71 3.38 0.51 0.22 
goals for students. 
erinents Bone wel reStier 3,567 3.15 0.59 171 3.56 0.50 0.40 
instruction is informed by data. 
Attitudes toward Data subscale 
PEER i MBOr anita use Gata tO 3,567 5 0.58 171 350 0.52 ~0.35 
inform education practice. 
| like to use data. 3,571 2.93 0.71 171 3.39 0.59 —0.46 
| find data useful. 3,569 3.09 0.62 171 3.47 0.51 -0.38 
Using data Helps me ne auette 3,570 3.07 0.66 171 351 0.54 0.44 
[teacher/educator]. 


Note: Scale items were measured on a four-point scale in which 1 = strongly disagree, 2 = disagree, 3 = agree, and 4 = strongly agree. Brackets indicate where 
survey wording differed between the teacher and principal versions. 
Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table C8. Item-level means and standard deviations of teachers’ and principals’ perceptions of organizational 
supports for using data, 2019 


Teachers aiatell o-1155 
Sim-laler-] ae} Standard Mean 


SIU] oksfor=)(=¥r-] ale inclan) Number Mean deviation Number Mean deviation difference 


Support for Data Use subscale 
[| am/My teachers are] adequately 


supported in the effective use of data. iis aoe mee a7 2.98 0.55 =a08 
Hemi My teacners are] adequately 3,571 2.89 0.67 171-287 0.59 0.01 
prepared to use data. 

Tels someone Who answets my Tiny 3,571 3.03 0.69 171 3.19 0.61 0.16 


teachers’] questions about using data. 
There is someone who helps [my/my 
teachers’] change [my/their] practice (e.g., 3,570 2.75 0.75 171 2.93 0.61 -0.18 
my/their teaching) based on data. 

My district [provides/provides my teachers] 

enough professional development about 3,567 2.84 0.78 171 2.78 0.73 0.06 
data use. 

My district’s [professional 
development/professional development for 
my teachers] is useful for learning about 
data use. 


3,567 2.76 0.77 171 2.86 0.66 —0.09 


Principal Leadership subscale 
[My principal or assistant principal(s) 
encourages/I encourage] data use as a tool 3,570 3.20 0.63 170 3.42 0.52 —0.22 
to support effective teaching. 
[My principal or assistant principal(s) 
creates/I create] many opportunities for 3,570 2.93 0.74 171 3.09 0.66 -0.16 
teachers to use data. 
[My principal or assistant principal(s) has/I 
have] made sure teachers have plenty of 3,571 2.82 0.77 171 2.84 0.74 —0.02 
training for data use. 
[My principal or assistant principal(s) is/I am] 
a good example of an effective data user. 
[My principal or assistant principal(s) 
discusses/I discuss] data with [me/my 3,571 2.88 0.76 171 3.28 0.55 -0.39 
teachers]. 
[My principal or assistant principal(s) 
creates/I create] protected time for using 3,567 2.70 0.84 171 2.96 0.72 -0.26 
data. 

Computer Data Systems subscale 
| have the proper technology to efficiently 
examine data. 
The computer systems in my district 
provide me access to lots of data. 
The computer systems (for data use) in my 
district are easy to use. 
The computer systems in my district allow 
me to examine various types of data at 
once (e.g., attendance, achievement, 
demographics). 
The computer systems in my district 
generate displays (e.g., reports, graphs, 3,565 3.01 0.68 171 3.15 0.72 —0.14 
tables) that are useful to me. 


3,565 2.98 0.76 171 3.04 0.67 —0.05 


3,571 3.16 0.61 171 3.42 0.53 —0.26 
3,569 3.12 0.63 170 3.41 0.58 -0.29 


3,566 3.01 0.69 171 3.22 0.66 -0.21 


3,569 3.03 0.68 171 3.20 0.73 -0.17 


Note: Scale items were measured on a four-point scale in which 1 = strongly disagree, 2 = disagree, 3 = agree, and 4 = strongly agree. Brackets indicate where 
survey wording differed between the teacher and principal versions. 
Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 
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Table C9. Item-level means and standard deviations of teachers’ perceived competence in using data and 

principals’ perceptions of teacher competence in using data, 2019 
Teachers aiatell ex-1 5 

Slilalel-lae! S\ilalel-] ae] Mean 


Scale item Number Mean deviation Number Mean deviation difference 
[| am/My teachers are] good at using 


data to diagnose student learning needs. 27310 eee O.6t wey aoe cad 0.02 
War icdchersarelecodstediusine: 27575 2.96 0.60 171 2.88 0.56 0.09 
instruction based on data. 

Maniliy Seachiels ate] good at Using 3,572 2.87 0.63 171 281 0.57 0.05 
data to plan lessons. 

Warnilvly teachers ale] good -at- Using 3,568 2.91 0.63 171 284 059 0.07 


data to set student learning goals. 


Note: Scale items were measured on a four-point scale in which 1 = strongly disagree, 2 = disagree, 3 = agree, and 4 = strongly agree. Brackets indicate where 
survey wording differed between the teacher and principal versions. 
Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table C10. Complete results for the hierarchical linear model examining the association between teachers’ 
perceived competence in using data, attitudes toward data, and perceptions of organizational supports for 
using data, and their actions with summative data, 2019 


NEVar-le)(=1 Coefficient Sli-lalol-lae Manele 
Intercept 1.73*** 0.02 
Competence in using data 0.19*** 0.04 
Attitudes toward data 0.06 0.04 
Organizational supports for using data 0.20*** 0.04 
School level? 

Middle school —0.07 0.04 

High school —0.17*** 0.04 
Title | school 0.05 0.04 
Teacher’s highest degree earned’ 

Master’s degree —0.02 0.03 

More-advanced degree —0.22 0.15 
Teacher has special education endorsement —0.02 0.04 
Teacher teaches core subject 0.21*** 0.04 
Years of experience in education® 

5 or fewer years 0.02 0.04 

6-12 years 0.05 0.04 

13-21 years -0.01 0.04 


*** Significant at p < .001. 

Note: n = 2,277 teachers in 348 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model competence with data, attitudes toward data, organizational supports, master’s degree, more-advanced degree, teacher has special education 
endorsement, teacher teaches core subject, 5 or fewer years of experience in education, 6-12 years of experience in education, and 13-21 years of 
experience in education were all centered around the school mean. Middle school, high school, and Title | school were all centered around the mean for the 
whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 
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Table C11. Complete results for the hierarchical linear model examining the association between teachers’ 
perceived competence in using data, attitudes toward data, and perceptions of organizational supports for 
using data, and their actions with interim data, 2019 


NEVar-le)(=1 Coefficient S\i-lalol-lac Manele 
Intercept 1.78*** 0.02 
Competence in using data 0.23*** 0.03 
Attitudes toward data 0.08 0.04 
Organizational supports for using data 0.22*** 0.03 
School level? 

Middle school —0.22*** 0.05 

High school —0.46*** 0.05 
Title | school 0.01 0.04 
Teacher’s highest degree earned’ 

Master’s degree 0.02 0.03 

More-advanced degree —0.13 0.18 
Teacher has special education endorsement 0.04 0.03 
Teacher teaches core subject 0.16*** 0.03 
Years of experience in education‘ 

5 or fewer years 0.16*** 0.04 

6-12 years 0.09 0.04 

13-21 years 0.04 0.04 


*** Significant at p < .001. 

Note: n = 2,665 teachers in 350 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model competence with data, attitudes toward data, organizational supports, master’s degree, more-advanced degree, teacher has special education 
endorsement, teacher teaches core subject, 5 or fewer years of experience in education, 6-12 years of experience in education, and 13-21 years of 
experience in education were all centered around the school mean. Middle school, high school, and Title | school were all centered around the mean for the 
whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 
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Table C12. Complete results for the hierarchical linear model examining the association between teachers’ 
perceived competence in using data, attitudes toward data, and perceptions of organizational supports for 
using data, and their actions with formative data, 2019 


NEVar-lel(=1 Coefficient S\i-lalol-lac Manele 
Intercept 2.46*** 0.02 
Competence in using data 0.30*** 0.03 
Attitudes toward data 0.13*** 0.03 
Organizational supports for using data 0.14*** 0.03 
School level? 

Middle school —0.21*** 0.05 

High school —0.33*** 0.05 
Title | school —0.07 0.05 
Teacher’s highest degree earned’ 

Master’s degree 0.02 0.03 

More-advanced degree —0.17 0.15 
Teacher has special education endorsement —0.08 0.03 
Teacher teaches core subject 0.25*** 0.03 
Years of experience in education‘ 

5 or fewer years 0.30*** 0.04 

6-12 years 0.22*** 0.04 

13-21 years 0.06 0.04 


*** Significant at p < .001. 

Note: n = 3,013 teachers in 351 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model competence with data, attitudes toward data, organizational supports, master’s degree, more-advanced degree, teacher has special education 
endorsement, teacher teaches core subject, 5 or fewer years of experience in education, 6-12 years of experience in education, and 13-21 years of 
experience in education were all centered around the school mean. Middle school, high school, and Title | school were all centered around the mean for the 
whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 
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Table C13. Complete results for the hierarchical linear model examining the association between teachers’ 
characteristics and their perceived competence in using data, 2019 


NV FVar-lel(=) Coefficient Si-lalol-lae Manel g 
Intercept 2.92*** 0.01 
School level? 

Middle school —0.26*** 0.03 

High school —0.27*** 0.03 
Title | school —0.01 0.03 
Teacher’s highest degree earned’ 

Master’s degree 0.08*** 0.02 

More-advanced degree 0.27 0.11 
Teacher has special education endorsement 0.13*** 0.02 
Teacher teaches core subject —0.01 0.02 
Years of experience in education‘ 

5 or fewer years 0.05 0.03 

6-12 years 0.05 0.03 

13-21 years 0.01 0.03 


*** Significant at p < .001. 

Note: n = 3,572 teachers in 353 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C14. Predicted means for the hierarchical linear model examining the association between teachers’ 
characteristics and their perceived competence in using data, 2019 

Characteristic Predicted mean 

Teacher’s highest degree earned 


Bachelor’s degree? 2.88 

Master's degree 2.96 

More-advanced degree 3.17 
Teacher has special education endorsement 

No 2.89 

Yes 3.03 
Teacher teaches core subject 

No 2.93 

Yes 2.92 
Years of experience in education 

5 or fewer years 2.96 

6-12 years 2.96 

13-21 years 2.90 

22 or more years> 2.87 


Note: n = 3,572 teachers in 353 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
a. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

b. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C15. Complete results for the hierarchical linear model examining the association between teachers’ 
characteristics and their attitudes toward data, 2019 


NV FVar-le)(=1 Coefficient Standard error 
Intercept 3.107 ** 0.01 
School level? 

Middle school —0.24*** 0.03 

High school —0.23*** 0.03 
Title | school 0.00 0.03 
Teacher’s highest degree earned’ 

Master’s degree 0.06** 0.02 

More-advanced degree 0.26 0.10 
Teacher has special education endorsement 0.12*** 0.02 
Teacher teaches core subject 0.04 0.02 
Years of experience in education‘ 

5 or fewer years 0.14*** 0.03 

6-12 years 0.07** 0.02 

13-21 years 0.00 0.02 


** Significant at p < .01; *** Significant at p < .001. 

Note: n = 3,572 teachers in 353 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C16. Predicted means for the hierarchical linear model examining the association between teachers’ 
characteristics and their attitudes toward data, 2019 


Teacher’s highest degree earned 
Bachelor’s degree? 3.07 
Master's degree 3.13 
More-advanced degree 3.36 
Teacher has special education endorsement 
No 3.07 
Yes 3.20 
Teacher teaches core subject 
No 3.09 
Yes 3.12 
Years of experience in education 
5 or fewer years 3.21 
6-12 years 3.13 
13-21 years 3.05 
22 or more years? 3.04 


Note: n = 3,572 teachers in 353 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
a. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

b. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C17. Complete results for the hierarchical linear model examining the association between teachers’ 
characteristics and their perceptions of organizational supports for using data, 2019 


NV FVar-lel(=1 Coefficient Standard error 
Intercept 2.977** 0.01 
School level? 

Middle school —0.19*** 0.04 

High school —0.25*** 0.04 
Title | school —0.05 0.03 
Teacher’s highest degree earned’ 

Master's degree 0.01 0.02 

More-advanced degree —0.01 0.10 
Teacher has special education endorsement 0.04 0.02 
Teacher teaches core subject —0.06** 0.02 
Years of experience in education® 

5 or fewer years —-0.01 0.03 

6-12 years —0.03 0.02 

13-21 years —0.03 0.02 


** Significant at p < .01; *** Significant at p < .001. 

Note: n = 3,572 teachers in 353 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C18. Predicted means for the hierarchical linear model examining the association between teachers’ 
characteristics and their perceptions of organizational supports for using data, 2019 

Characteristic Predicted mean 

Teacher’s highest degree earned 


Bachelor’s degree? 2.96 

Master's degree 2.97 

More-advanced degree 2.96 
Teacher has special education endorsement 

No 2.96 

Yes 3.00 
Teacher teaches core subject 

No 2.99 

Yes 2.94 
Years of experience in education 

5 or fewer years 2.98 

6-12 years 2.96 

13-21 years 2.96 

22 or more years> 2.97 


Note: n = 3,572 teachers in 353 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
a. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

b. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C19. Complete results for the hierarchical linear model examining the association between teachers’ 
characteristics and their self-reported actions with summative data, 2019 


NV FVar-le)(=1 Coefficient S\i-lalol-lac Manel g 
Intercept 1,.737** 0.02 
School level? 

Middle school —0.07 0.04 

High school —0.17*** 0.04 
Title | school 0.04 0.04 
Teacher’s highest degree earned’ 

Master's degree 0.00 0.03 

More-advanced degree —0.14 0.16 
Teacher has special education endorsement 0.01 0.04 
Teacher teaches core subject 0.18*** 0.04 
Years of experience in education‘ 

5 or fewer years 0.04 0.05 

6-12 years 0.07 0.04 

13-21 years —0.01 0.04 


*** Significant at p < .001. 

Note: n = 2,277 teachers in 348 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C20. Predicted means for the hierarchical linear model examining the association between teachers’ 
characteristics and their self-reported actions with summative data, 2019 

Characteristic Predicted mean 

Teacher’s highest degree earned 


Bachelor’s degree? 1.73 

Master's degree 1.73 

More-advanced degree 1.57 
Teacher has special education endorsement 

No 1.73 

Yes 1.72 
Teacher teaches core subject 

No 1.64 

Yes 1.81 
Years of experience in education 

5 or fewer years 1.75 

6-12 years 1.78 

13-21 years 1.68 

22 or more years? 1.70 


Note: n = 2,277 teachers in 348 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
a. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

b. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C21. Complete results for the hierarchical linear model examining the association between teachers’ 
characteristics and their self-reported actions with interim data, 2019 


NV FVar-le)(=1 Coefficient Si-lalol-lne Manel g 
Intercept 1.78*** 0.02 
School level? 

Middle school —0.23*** 0.05 

High school —0.46*** 0.05 
Title | school 0.01 0.04 
Teacher’s highest degree earned’ 

Master's degree 0.05 0.03 

More-advanced degree —0.08 0.18 
Teacher has special education endorsement 0.08 0.03 
Teacher teaches core subject 0.12*** 0.04 
Years of experience in education‘ 

5 or fewer years 0.18*** 0.04 

6-12 years 0.10 0.04 

13-21 years 0.04 0.04 


*** Significant at p < .001. 

Note: n = 2,665 teachers in 350 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C22. Predicted means for the hierarchical linear model examining the association between teachers’ 
characteristics and their self-reported actions with interim data, 2019 

Characteristic Predicted mean 

Teacher’s highest degree earned 


Bachelor’s degree? 1.75 

Master's degree 1.80 

More-advanced degree 1.72 
Teacher has special education endorsement 

No 1.76 

Yes 1.83 
Teacher teaches core subject 

No 1.72 

Yes 1.83 
Years of experience in education 

5 or fewer years 1.88 

6-12 years 1.81 

13-21 years 1.73 

22 or more years? 1.70 


Note: n = 2,665 teachers in 350 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
a. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

b. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C23. Complete results for the hierarchical linear model examining the association between teachers’ 
characteristics and their self-reported actions with formative data, 2019 


NV FVar-le)(=1 Coefficient Si-lalol-lne Manel g 
Intercept 2.46*** 0.02 
School level? 

Middle school —0.20*** 0.05 

High school —0.32*** 0.05 
Title | school —0.07 0.05 
Teacher’s highest degree earned’ 

Master's degree 0.05 0.03 

More-advanced degree —0.06 0.16 
Teacher has special education endorsement —0.02 0.03 
Teacher teaches core subject 0.23*** 0.03 
Years of experience in education‘ 

5 or fewer years 0.33*** 0.04 

6-12 years 0.24** 0.04 

13-21 years 0.06 0.04 


** Significant at p < .01; *** Significant at p < .001. 

Note: n = 3,013 teachers in 351 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C24. Predicted means for the hierarchical linear model examining the association between teachers’ 
characteristics and their self-reported actions with formative data, 2019 

Characteristic Predicted mean 

Teacher’s highest degree earned 


Bachelor’s degree? 2.41 

Master's degree 2.50 

More-advanced degree 2.47 
Teacher has special education endorsement 

No 2.46 

Yes 2.45 
Teacher teaches core subject 

No 2.37 

Yes 2.56 
Years of experience in education 

5 or fewer years 2.65 

6-12 years 2.56 

13-21 years 2.37 

22 or more years? 2.28 


Note: n = 3,013 teachers in 351 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
a. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

b. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C25. Complete results for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ perceived competence in using data, 2019 


NEVar-le)(=) Coefficient Si-lalol-lacMlanels 
Intercept 2.92*** 0.01 
School accountability classification” 

Good 0.00 0.03 

Great 0.03 0.04 

Excellent 0.01 0.04 
School level’ 

Middle school —0.25*** 0.03 

High school —0.27*** 0.03 
Title | school 0.00 0.03 
Teacher’s highest degree earned 

Master’s degree 0.08*** 0.02 

More-advanced degree 0.27 0.11 
Teacher has special education endorsement 0.13*** 0.02 
Teacher teaches core subject —0.01 0.02 
Years of experience in education* 

5 or fewer years 0.05 0.03 

6-12 years 0.05 0.03 

13-21 years 0.01 0.03 


*** Significant at p < .001. 

Note: n = 3,572 teachers in 353 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, excellent, middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

b. Elementary school was the reference category for school level. 

c. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

d. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C26. Predicted means for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ perceived competence in using data, 2019 


Noi aYofo) Wr-Lexero 0) ai] 6) | fia vmel t=) hiler-ia (eye) Predicted mean 


Needs Improvement? 2.91 
Good 2.91 
Great 2.94 
Excellent 2.93 


Note: n = 3,572 teachers in 353 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, and excellent were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C27. Complete results for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ attitudes toward data, 2019 


NV FVar-le)(=1 Coefficient SJ i-lalol-lacMlanelg 
Intercept 3.107** 0.01 
School accountability classification” 

Good —0.01 0.03 

Great —0.01 0.03 

Excellent 0.00 0.03 
School level’ 

Middle school —0.24*** 0.03 

High school —0.23*** 0.03 
Title | school 0.00 0.03 
Teacher’s highest degree earned 

Master’s degree 0.06** 0.02 

More-advanced degree 0.26 0.10 
Teacher has special education endorsement 0.12*** 0.02 
Teacher teaches core subject 0.04 0.02 
Years of experience in education* 

5 or fewer years 0.14*** 0.03 

6-12 years 0.07** 0.02 

13-21 years 0.00 0.02 


** Significant at p < .01; *** Significant at p < .001. 

Note: n = 3,572 teachers in 353 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, excellent, middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

b. Elementary school was the reference category for school level. 

c. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

d. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C28. Predicted means for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ attitudes toward data, 2019 


Noi afofo) Wr-Lexero 0) ai] 6) | fia vmel =I) hiler-ia (eye) Predicted mean 


Needs Improvement? 3.11 
Good 3.10 
Great 3.10 
Excellent 3.11 


Note: n = 3,572 teachers in 353 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, and excellent were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C29. Complete results for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ perceptions of organizational supports for using data, 2019 


NEVar-le)(=1 Coefficient Standard error 
Intercept 2.977** 0.01 
School accountability classification” 

Good 0.05 0.04 

Great 0.10** 0.04 

Excellent 0.09 0.04 
School level’ 

Middle school —0.17*** 0.04 

High school —0.24*** 0.04 
Title | school —0.02 0.03 
Teacher’s highest degree earned 

Master's degree 0.01 0.02 

More-advanced degree —0.01 0.10 
Teacher has special education endorsement 0.04 0.02 
Teacher teaches core subject —0.06** 0.02 
Years of experience in education* 

5 or fewer years —-0.01 0.03 

6-12 years —0.03 0.02 

13-21 years —0.03 0.02 


** Significant at p < .01; *** Significant at p < .001. 

Note: n = 3,572 teachers in 353 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, excellent, middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

b. Elementary school was the reference category for school level. 

c. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

d. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C30. Predicted means for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ perceptions of organizational supports for using data, 2019 


Yel af ole) Wr-Lexero lb) au] 6) fiavmel t=) hiler-ya(e)a) Predicted mean 


Needs Improvement? 2.91 
Good 2.96 
Great 3.01 
Excellent 3.00 


Note: n = 3,572 teachers in 353 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, and excellent were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C31. Complete results for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ self-reported actions with summative data, 2019 


NEVar-lel(=1 Coefficient Si-lalol-lecMlanelg 
Intercept 1.73** 0.02 
School accountability classification® 

Good —0.04 0.04 

Great 0.00 0.04 

Excellent 0.03 0.05 
School level’ 

Middle school —0.06 0.04 

High school —0.16*** 0.04 
Title | school 0.05 0.04 
Teacher’s highest degree earned 

Master's degree 0.00 0.03 

More-advanced degree —0.14 0.16 
Teacher has special education endorsement 0.01 0.04 
Teacher teaches core subject 0.18*** 0.04 
Years of experience in education* 

5 or fewer years 0.04 0.05 

6-12 years 0.07 0.04 

13-21 years —0.01 0.04 


*** Significant at p < .001. 

Note: n = 2,277 teachers in 348 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, excellent, middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

a. Elementary school was the reference category for school level. 

b. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

c. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C32. Predicted means for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ self-reported actions with summative data, 2019 


Yel aYofo) ir-Lexerol 0) aut] 6) | fiavael t=) hiler-ya(e)a) Predicted mean 


Needs Improvement? 1.73 
Good 1.69 
Great 1.73 
Excellent 1.76 


Note: n = 2,277 teachers in 348 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, and excellent were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C33. Complete results for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ self-reported actions with interim data, 2019 


NFVar-le)(=1 Coefficient S\i-lalol-lne Manel g 
Intercept 1.777** 0.02 
School accountability classification® 

Good —0.06 0.05 

Great —0.11 0.05 

Excellent —0.11 0.05 
School level’ 

Middle school —0.24*** 0.04 

High school —0.48*** 0.05 
Title | school —0.03 0.04 
Teacher’s highest degree earned 

Master's degree 0.05 0.03 

More-advanced degree —0.08 0.18 
Teacher has special education endorsement 0.08 0.03 
Teacher teaches core subject 0.12*** 0.04 
Years of experience in education* 

5 or fewer years 0.18*** 0.04 

6-12 years 0.10 0.04 

13-21 years 0.04 0.04 


*** Significant at p < .001. 

Note: n = 2,665 teachers in 350 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, excellent, middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

b. Elementary school was the reference category for school level. 

c. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

d. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C34. Predicted means for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ self-reported actions with interim data, 2019 


Yel af ole) Wr-Lexero 0) ane] 6) | fiavael =k) hiler-ia(e)a) Predicted mean 


Needs Improvement? 1.84 
Good 1.78 
Great 1.73 
Excellent 1.74 


Note: n = 2,665 teachers in 350 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13—21 years of experience in education were all centered around the school mean. 
Good, great, and excellent were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Table C35. Complete results for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ self-reported actions with formative data, 2019 


NV FVar-le)(=1 Coefficient S\i-lalol-lae Manele 
Intercept 2.46*** 0.02 
School accountability classification” 

Good —0.07 0.05 

Great —0.08 0.06 

Excellent —0.14 0.06 
School level’ 

Middle school —0.22*** 0.05 

High school —0.35*** 0.05 
Title | school -0.11 0.05 
Teacher’s highest degree earned 

Master's degree 0.05 0.03 

More-advanced degree —0.06 0.16 
Teacher has special education endorsement —0.02 0.03 
Teacher teaches core subject 0.23*** 0.03 
Years of experience in education4 

5 or fewer years 0.33*** 0.04 

6-12 years 0.24** 0.04 

13-21 years 0.06 0.04 


** Significant at p < .01; *** Significant at p < .001. 

Note: n = 3,013 teachers in 351 schools. Coefficients are from a two-level multiple regression model that accounted for the nesting of teachers within schools. 
In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years of 
experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, excellent, middle school, high school, and Title | school were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

b. Elementary school was the reference category for school level. 

c. Bachelor’s degree was the reference category for teacher’s highest degree earned. 

d. 22 or more years was the reference category for years of experience in education. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 


Table C36. Predicted means for the hierarchical linear model examining the association between school 
accountability classifications and teachers’ self-reported actions with formative data, 2019 


Yel afofo) ir-(orerol 0) aie] 6) | [iavael =k) hiler-ia(e)a) Predicted mean 


Needs improvement? 2.53 
Good 2.47 
Great 2.45 
Excellent 2.39 


Note: n = 3,013 teachers in 351 schools. Predicted means are from a two-level multiple regression model that accounted for the nesting of teachers within 
schools. In this model master’s degree, more-advanced degree, teacher has special education endorsement, teacher teaches core subject, 5 or fewer years 
of experience in education, 6-12 years of experience in education, and 13-21 years of experience in education were all centered around the school mean. 
Good, great, and excellent were all centered around the mean for the whole sample. 

a. Needs improvement was the reference category for school accountability classification. 

Source: Authors’ analysis of 2019 survey and administrative data from the Teacher Data Use Survey and the Nebraska Department of Education. 
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Appendix D. Other analyses 

This appendix presents analyses of Teacher Data Use Survey data from teachers and principals that are not 
presented in the report. These data include results about availability of summative, interim, and formative data 
to teachers (survey question 1; table D1); teachers’ and principals’ ratings of the various types of summative 
assessments used in Nebraska (tables D2—D4); and item-level means for the teacher and principal surveys (tables 
D5—D6). 


Table D1. Percentage of teachers who reported having summative, interim, and formative data available to 
them and percentage of principals who perceived teachers having these data types available to them, 2019 


Teachers ararell e-) 5 
Data type Number Percentage Number Percentage 
At least one type of summative assessment data 3,216 90 171 100 
available? 
Interim data available’ 3,340 93 168 98 
Formative data available 3,203 90 164 96 


a. The mean for summative data includes the average across ratings for five different summative assessment types available to Nebraska teachers. The 
summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics (grades 3-8), 
NSCAS science (grades 5 and 8), NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner students). 

b. Interim assessment is the MAP Growth interim assessment 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table D2. Percentage of teachers who did not use data and percentage of principals who perceived that 
teachers did not use data by summative assessment type, 2019 
Teachers ra arell o-165 


Summative assessment type Number Percentage Number Percentage 
Nebraska Student-Centered Assessment System 

(NSCAS) English language arts (grades 3-8) Dat be is - 
NSCAS mathematics (grades 3-8) 1,497 50 13 8 
NSCAS science (grades 5 and 8) 1,685 59 15 9 
NSCAS ACT (grade 11) 1,079 49 14 12 
English Language Proficiency Assessment for the 1,147 59 10 10 


21st Century (English learner students) 


Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table D3. Means and standard deviations of teachers’ frequency in using data and principals’ perceptions of 
teachers’ frequency in using data by summative assessment type, 2019 
Teachers atavell ex-1 5) 


Simlalel-lae} Nimlalel-lae} 
Summative assessment type Mean deviation Number Mean deviation 
Nebraska Student-Centered 
Assessment System (NSCAS) English 1,630 1.63 0.87 153 1.60 0.80 
language arts (grades 3-8) 
NSCAS mathematics (grades 3-8) 1,484 1.71 0.92 153 1.61 0.79 
NSCAS science (grades 5 and 8) 1,195 1.61 0.84 149 1.56 0.80 
NSCAS ACT (grade 11) 1,110 1.62 0.83 98 1.52 0.74 
English Language Proficiency 
Assessment for the 21st Century 809 1.62 0.85 91 1.48 0.73 


(English learner students) 


Note: Frequency was measured on a four-point scale in which 1 = less than once a month, 2 = once or twice a month, 3 = weekly or almost weekly, and 4 = 
a few times a week. Respondents had the opportunity to indicate that they did not use a given assessment. The means include only respondents who 
indicated frequency of use on the four-point scale and does not include respondents who indicated that they did not use the given data type. 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 
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Table D4. Means and standard deviations of teachers’ and principals’ perceptions of usefulness of data by 
summative assessment type, 2019 


Teachers ratarel ex-1 5 

Standard Standard 
Summative assessment type Mean deviation Mean deviation 
Nebraska Student-Centered 
Assessment System (NSCAS) English 2,987 1.88 0.89 166 2.39 0.84 
language arts (grades 3-8) 
NSCAS mathematics (grades 3-8) 2,981 1.83 0.93 166 2.37 0.83 
NSCAS science (grades 5 and 8) 2,880 1.70 0.88 164 2.36 0.82 
NSCAS ACT (grade 11) 2,189 1.85 0.92 112 2.41 0.78 
English Language Proficiency 
Assessment for the 21st Century 1,956 1.85 0.93 101 2.30 0.79 


(English learner students) 


Note: Usefulness was measured on a four-point scale in which 1 = not useful, 2 = somewhat useful, 3 = useful, and 4 = very useful. 
Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table D5. Item-level means and standard deviations of principals’ perceptions of teachers’ actions with 
summative, interim, and formative data, 2019 


Actions with summative data? Actions with interim data? Actions with formative data 
Number of Standard Number of Standard Number of S\ilalet-lae| 
Action with data items ro) a aol] ey=) SMa \Y/ (=¥-] 9 mC (=AVAF-14 (0) 0 Mun © aT aol] oY] (SMV, -¥-] a me (=) - 10) 0 NN ol dU aol] oY] KCN \Y/[=¥-] ae (“AVA (0) 0) 
To identify 
instructional content 160 1.29 0.53 168 2.24 0.79 163 3.04 0.76 


to use in class. 
To tailor instruction to 


individual students’ 160 133 0.58 168 233 0.83 163 3.00 0.79 
needs. 

To develop 

peo rimendetonstor 160 131 0.55 168 2.33 0.80 163 2.98 0.79 
additional 


instructional support. 

To form small groups 

of students for 160 1.28 0.51 168 2.27 0.78 163 2.93 0.81 
targeted instruction. 

To discuss data with a 

parent or guardian. 

To discuss data with a 

student. 

To meet with a 

specialist (e.g., 

instructional coach or 160 1.15 0.35 168 1.76 0.79 163 2.05 0.92 
data coach) about 

data. 

To meet with another 

teacher about data. 


160 1.08 0.27 168 1.55 0.70 163 1.99 0.91 


160 1.25 0.47 168 1.88 0.79 163 2.74 0.81 


160 1.26 0.46 168 2.07 0.80 163 2.54 0.90 


Note: Frequency of actions with summative data was measured on a scale in which 1 = one or two times a year, 2 = a few times a year, 3 = monthly, and 4 = 
weekly. Frequency of actions with interim and formative data was measured ona scale in which 1 = less than once a month, 2 = monthly, 3 = weekly, and 4 
=a few times a week. To make comparisons using the same scale, ratings for summative data were recoded to the interim and formative response scale. A 
rating of 4 (weekly) on the summative scale was recoded as a 3 (weekly or almost weekly) on the interim/formative scale, a rating of 3 (monthly) was recoded 
as a 2 (once or twice a month), and a rating of 2 or 1 was recoded as a 1 (less than once a month). 

a. The summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics (grades 
3-8), NSCAS science (grades 5 and 8), NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner students). 
b. Interim assessment is the MAP Growth Interim assessment. 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Table D6. Item-level means and standard deviations of teachers’ self-reported actions with summative data 
comparing the original survey response scale and recoded response scale, 2019 
Original response scale? Recoded response scale? 
Number of Simlaler-]ae| Number of Simlalel-]ae| 


PNotdfoyamivamersiemine)pats teachers Mean deviation teachers Mean deviation 
To identify instructional content 


? 2,268 1.93 0.90 2,268 1.37 0.60 
to use in class. 
Te taller imegruction te 2,268 1.89 0.88 2,268 1.35 0.58 
individual students’ needs. 
To develop recommendations 
for additional instructional 2,268 1.85 0.83 2,268 1.31 0.53 
support. 
To form small groups of 
students for targeted 2,268 1.75 0.82 2,268 1.27 0.50 
instruction. 
To aiseuss Saks Wille Datel eh 2,268 1.43 0.58 2,268 1.08 0.28 
guardian. 
To discuss data with a student. 2,268 1.64 0.75 2,268 1.20 0.44 
To meet with a specialist (e.g., 
instructional coach or data 2,268 1.48 0.67 2,268 1.13 0.35 
coach) about data. 
To meet with another teacher 2,268 1.76 0.78 2,268 1.24 0.47 


about data. 


Note: The summative assessments are Nebraska Student-Centered Assessment System (NSCAS) English language arts (grades 3-8), NSCAS mathematics 
(grades 3-8), NSCAS science (grades 5 and 8), NSCAS ACT (grade 11), and the English Language Proficiency Assessment for the 21st Century (English learner 
students). 

a. Frequency of actions with summative data were measured on a scale in which 1 = one or two times a year, 2 = a few times a year, 3 = monthly, and 4 = 
weekly. 

b. Ratings for summative data were recoded to the interim and formative response scale. A rating of 4 (weekly) on the summative scale was recoded as a3 
(weekly or almost weekly) on the interim/formative scale, a rating of 3 (monthly) was recoded as a 2 (once or twice a month), and a rating of 2 or 1 was 
recoded as a 1 (less than once a month). 

Source: Authors’ analyses of 2019 data from the Teacher Data Use Survey administered by the Nebraska Department of Education. 


Appendix E. Teacher and principal versions of the Teacher Data Use Survey 


The following appendix includes the teacher and principal versions of the Teacher Data Use Survey. 


Teacher Data Use Survey [Teacher Version] 


Welcome! The purpose of the Teacher Data Use Survey is to learn about how teachers use data for educational 
improvement in your district. Administering the Teacher Data Use Survey can provide many benefits to district and school 
leaders as well as teachers. Some of the benefits include: 


A comprehensive perspective on how teachers use data, their attitudes toward data, and the supports that help them use 
data. 


An evidence base from which to plan ongoing support, such as professional development, computer data systems, and 
collaborative structures for data use. 


A triangulated assessment of how administrator and instructional support staff view teacher data use. 


The Teacher Data Use Survey takes about 15—20 minutes to complete. Your responses will remain confidential, and reports 
will only use aggregated results. 


As a teacher, we value your input and trust that the information you provide will be vital to the success of this survey. 
Please continue to the next page to start the survey. 


The Teacher Data Use Survey is prepared by Jeffrey C. Wayman, Vincent Cho, Ellen B. Mandinach, Jonathan A. Supovitz, and 
Stephanie B. Wilkerson for the Institute of Education Sciences (JES) under Contract ED-JES-12-C-0005 by Regional 
Educational Laboratory Appalachia administered by CNA. 


1. Are the following forms of data available to you at [School]? 


Yes No 
a. NSCAS-English Language Arts () () 
b. NSCAS-Mathematics () () 
c. NSCAS-Science () () 
d. NSCAS-ACT () () 
e. ELPA21 () () 
f. | MAP Growth (NWEA) () () 
g. Formative Assessments () () 
h. Perceptual Data (i.e., perceptions of learning environment) () () 
i. Other (please specify): () () 


If you indicated “no” to all options in question 1, skip to question 11. If you responded ‘yes’ to any option, please proceed 
to question 2. 
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2. Teachers use all kinds of information (i.e., data) to help plan for instruction that meets student learning needs. How 
frequently do you use the following forms of data? 
Less than once a Once ortwicea Weekly or A few times a 


Do not use month month almost weekly week 
NSCAS-English Language Arts () () () () () 
NSCAS-Mathematics () () () () () 
NSCAS-Science () () () () () 
NSCAS-ACT 
ELPA21 


MAP Growth (NWEA) 

Formative Assessments 

Perceptual Data (i.e., perceptions of 
learning environment) 


i. Other: () () () () () 


SH AD AO TD 


3. Now, how useful are the following forms of data to your practice? 


Not Somewhat Very 

useful useful Useful useful 
NSCAS-English Language Arts () () () 
NSCAS-Mathematics () () () 
NSCAS-Science () 
NSCAS-ACT () 
ELPA21 () 


() 
() 
() 
() 


Formative Assessments 
Perceptual Data (i.e., perceptions of learning environment) 
Other: 


- sma rOQ009 
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() () 
() () 
() () 
MAP Growth (NWEA) () () 
() () 
() () 
() () 


If you indicated that NSCAS-English Language Arts is “not available” to you in question 1, OR if you indicated that you “do 
not use” NSCAS-English Language Arts in question 2, please go to question 5. 


4. These questions ask about NSCAS-English Language Arts. In a typical school year, how often do you do the following? 
One ortwo Afewtimesa 


times a year year Monthly Weekly 

a. UseNSCAS-EnglishLanguage Arts toidentify instructional 

content to use in class. () () () () 
b. Use NSCAS-English Language Arts to tailor instruction to 

individual students’ needs. () () () () 
c. Use NSCAS-English Language Arts to develop 

recommendations for additional instructional support. () () () () 
d. Use NSCAS-English Language Arts to form small groups of 

students for targeted instruction. () () () () 
e. Discuss NSCAS-English Language Arts with a parent or 

sardlai () () () () 
f. Discuss NSCAS-English Language Arts with a student. () () () () 


g. Meet with a specialist (e.g., instructional coach or data coach) 
about NSCAS-English Language Arts. 

h. Meet with another teacher about NSCAS- English Language 
Arts. 


If you indicated that NSCAS-Mathematics is “not available” to you in question 1, OR if you indicated that you “do not use” 
NSCAS-Mathematics in question 2, please go to question 6. 
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5. These questions ask about NSCAS-Mathematics. In a typical school year, how often do you do the following? 
One ortwo A fewtimesa 


times a year year Monthly Weekly 

a. Use NSCAS-Mathematics to identify instructional content to 

use in class. () () () () 
b. Use NSCAS-Mathematics to tailor instruction to individual 

students’ needs. () () () () 
c. Use NSCAS-Mathematics to develop recommendations for 

additional instructional support. () () () () 
d. Use NSCAS-Mathematics to form small groups of students for 

targeted instruction. () () () () 
e. Discuss NSCAS-Mathematics with a parent or guardian. () () () 
f. Discuss NSCAS-Mathematics with a student. () () () 
g. Meet with a specialist (e.q., instructional coach or data coach) 

about NSCAS-Mathematics. () () () () 
h. Meet with another teacher about NSCAS- Mathematics. () () () () 


If you indicated that NSCAS-Science is “not available” to you in question 1, OR if you indicated that you “do not use” NSCAS- 
Science in question 2, please go to question 7. 


6. These questions ask about NSCAS-Science. In a typical school year, how often do you do the following? 
One ortwo A fewtimesa 


times a year year Monthly Weekly 
a. Use NSCAS-Science to identify instructional content to use in 
| () () () () 
class. 
b. Use NSCAS-Science to tailor instruction to individual students’ 
needs () () () () 
c. Use NSCAS-Science to develop recommendations for () () () () 
additional instructional support. 
d. Use NSCAS-Science to form small groups of students for () () () () 
targeted instruction. 
e. Discuss NSCAS-Science with a parent or guardian. () () () () 
f. Discuss NSCAS-Science with a student. () () () () 
g. Meet with a specialist (e.g., instructional coach or data coach) () () () () 
about NSCAS-Science. 
h. Meet with another teacher about NSCAS- Science. () () () () 


If you indicated that NSCAS-ACT is “not available” to you in question 1, OR if you indicated that you “do not use” NSCAS- 
ACT in question 2, please go to question 8. 


7. These questions ask about NSCAS-ACT. In a typical school year, how often do you do the following? 
One ortwo Afewtimesa 


times a year year Monthly Weekly 
a. Use NSCAS-ACT to identify instructional content to use in 
| () () () () 
class. 
b. Use NSCAS-ACT to tailor instruction to individual students’ 
() () () () 
needs. 
c. Use NSCAS-ACT to develop recommendations for additional () () () () 
instructional support. 
d. Use NSCAS-ACT to form small groups of students for targeted () () () () 
instruction. 
e. Discuss NSCAS-ACT with a parent or guardian. () () () () 
f. Discuss NSCAS-ACT with a student. () () () () 
g. Meet with a specialist (e.g., instructional coach or data coach) () () () () 
about NSCAS-ACT. 
h. Meet with another teacher about NSCAS-ACT. () () () () 
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If you indicated that ELPA21 is “not available” to you in question 1, OR if you indicated that you “do not use” ELPA21 in 
question 2, please go to question 9. 


8. These questions ask about ELPA21. In a typical school year, how often do you do the following? 
One ortwo Afewtimesa 


times a year year Monthly Weekly 

a. Use ELPA21 to identify instructional content to use in class. () () () () 

Use ELPA21 to tailor instruction to individual students’ needs. () () () () 
c. Use ELPA21 to develop recommendations for additional 

instructional support. () () () () 
d. Use ELPA21 to form small groups of students for targeted 

instruction. () () () () 
e. Discuss ELPA21 with a parent or guardian. () () () () 
f. Discuss ELPA21 with a student. () () () () 
g. Meet with a specialist (e.g., instructional coach or data coach) 

about ELPA21. () () () () 
h. Meet with another teacher about ELPA21. () () () () 


If you indicated that MAP Growth (NWEA) is “not available” to you in question 1, OR if you indicated that you “do not use” 
MAP Growth (NWEA) in question 2, please go to question 10. 


9. These questions ask about MAP Growth (NWEA) used in your school or district. In a typical month, how often do you 

do the following? 
Lessthan Onceortwice Weeklyor Afewtimesa 
onceamonth amonth almost weekly week 

a. Use MAP Growth (NWEA) to identify instructional content to 
use in class. 

b. Use MAP Growth (NWEA) to tailor instruction to individual 
students’ needs. 

c. Use MAP Growth (NWEA) to develop recommendations for 
additional instructional support. 

d. Use MAP Growth (NWEA) to form small groups of students 
for targeted instruction. 

e. Discuss MAP Growth (NWEA) with a parent or guardian. () () () () 

f. Discuss MAP Growth (NWEA) with a student. () () () () 

g. Meet with a specialist (e.g., instructional coach or data coach) 
about MAP Growth (NWEA). 

h. Meet with another teacher about MAP Growth (NWEA). () () () () 


If you indicated that Formative Assessments are “not available” to you in question 1, OR if you indicated that you “do not 
use” Formative Assessments in question 2, please go to question 11. 
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10. These questions ask about Formative Assessments developed and used in your school or district. In a typical month, 
how often do you do the following? 
Lessthan Onceortwice Weeklyor Afewtimesa 
onceamonth amonth almost weekly week 
a. Use Formative Assessments to identify instructional content 
to use in class. () () () () 
b. Use Formative Assessments to tailor instruction to individual 
students’ needs. 
c. Use Formative Assessments to develop recommendations for 
additional instructional support. 
d. Use Formative Assessments to form small groups of students 
for targeted instruction. 
e. Discuss Formative Assessments with a parent or guardian. () () () () 
f. Discuss Formative Assessments with a student. () () () () 
g. Meet with a specialist (e.g., instructional coach or data coach) 
about Formative Assessments. 
h. Meet with another teacher about Formative Assessments . () () () () 


The remainder of this survey asks general questions about the use of data to inform your education practice. For the rest of 
this survey, please consider only the following when you are asked about "data": 


NSCAS-English Language Arts 
NSCAS-Mathematics 
NSCAS-Science 

NSCAS-ACT 

ELPA21 

MAP Growth (NWEA) 
Formative assessments 


11. These questions ask about supports for using data. Please indicate how much you agree or disagree with the 
following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
a. l|amadequately supported inthe effective use of data. () () () () 
b. lam adequately prepared to use the data. () () () () 
There is someone who answers my questions about using 
a () () () () 


d. There is someone who helps me change my practice (e.g., my 
teaching) based on data. 

e. My district provides enough professional development about 
data use. 

f. My district’s professional development is useful for learning 
about data use. 
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12. These questions ask about your attitudes and opinions regarding data. Please indicate how much you agree or 
disagree with the following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
a. Data help teachers plan instruction. () () () () 
b. Data offer information about students that was not already 
on () () () () 
c. Data help teachers know what concepts students are 
learniniz () () () () 
d. Data help teachers identify learning goals for students. () () () () 
e. Students benefit when teacher instruction is informed by 
dara: () () () () 
f. | think it is important to use data to inform education 
practice: () () () () 
g. 1|like to use data. 


h. | find data useful. 
i. Using data helps me be a better teacher. 


13. These questions ask how your principal and assistant principal(s) support you in using data. Principals and assistant 
principals will not be able to see your answers. Please indicate how much you agree or disagree with the following 
statements: 

Strongly 
disagree Disagree Agree Strongly agree 

a. My principal or assistant principal(s) encourages data use as a 

tool to support effective teaching. () () () () 

b. My principal or assistant principal(s) creates many 
opportunities for teachers to use data. 

c. My principal or assistant principal(s) has made sure teachers 
have plenty of training for data use. 

d. My principal or assistant principal(s) is a good example of an 
effective data user. 

e. My principal or assistant principal(s) discusses data with me. () () () () 

f. My principal or assistant principal(s) creates protected time 
for using data. () () () () 


14. Your school or district gives you programs, systems, and other technology to help you access and use student data. 
The following questions ask about these computer systems. Please indicate how much you agree or disagree with the 
following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
a. Ihave the proper technology to efficiently examine data. () () () () 
b. The computer systems in my district provide me access to lots 
() () () () 
of data. 
c. The computer systems (for data use) in my district are easy to 
() () () () 
use. 
d. The computer systems in my district allow me to examine 
various types of data at once (e.g., attendance, achievement, () () () () 


demographics). 
e. The computer systems in my district generate displays (e.g., 
reports, graphs, tables) that are useful to me. 
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15. These questions ask about your attitudes towards your own use of data. Please indicate how much you agree or 


disagree with the following statements. 


Qoo0o 


16. Please select the grade(s) to which you are assigned at THIS school: [School] 


lam good at using data to diagnose student learning needs. 
lam good at adjusting instruction based on data. 

| am good at using data to plan lessons. 

lam good at using data to set student learning goals. 


Strongly 


Disagree Agree agree 


() () () 
() () () 
() () () 
() () () 


Please check all that apply. If you do not teach specific grades, please select the last option "None of the above". 


e Prekindergarten 
e Kindergarten 

e ist Grade 

e 2nd Grade 

e 3rd Grade 

e Ath Grade 

e 5thGrade 

e 6thGrade 

e 7th Grade 

e 8th Grade 

e 9th Grade 

e 10th Grade 

e 11th Grade 

e 12th Grade 

e None of the above 


17. Please specify the number of years you have been TEACHING. 


18. What else would you like to share with us about data use? 


For more information about this survey, please contact: NDE.Research@nebraska.gov 
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Teacher Data Use Survey [Principal Version] 


Welcome! The purpose of the Teacher Data Use Survey is to learn about how teachers use data for educational 
improvement in your district. Administering the Teacher Data Use Survey can provide many benefits to district and school 
leaders as well as teachers. Some of the benefits include: 


A comprehensive perspective on how teachers use data, their attitudes toward data, and the supports that help them use 
data. 


An evidence base from which to plan ongoing support, such as professional development, computer data systems, and 
collaborative structures for data use. 


A triangulated assessment of how administrator and instructional support staff view teacher data use. 


The Teacher Data Use Survey takes about 15-20 minutes to complete. Your responses will remain confidential, and reports 
will only use aggregated results . 


As a principal, we value your input and trust that the information you provide will be vital to the success of this survey. 
Please continue to the next page to start the survey. 


The Teacher Data Use Survey is prepared by Jeffrey C. Wayman, Vincent Cho, Ellen B. Mandinach, Jonathan A. Supovitz, and 
Stephanie B. Wilkerson for the Institute of Education Sciences (JES) under Contract ED-JES-12-C-0005 by Regional 
Educational Laboratory Appalachia administered by CNA. 


1. Are the following forms of data available to your teachers at [school]? 


Yes No 
a. NSCAS-English Language Arts () () 
b. NSCAS-Mathematics () () 
c. NSCAS-Science () () 
d. NSCAS-ACT () () 
e. ELPA21 () () 
f. | MAP Growth (NWEA) () () 
g. Formative Assessments () () 
h. Perceptual Data (i.e., perceptions of learning environment) () () 
i. Other (please specify): () () 


If you indicated “no” to all options in question 1, skip to question 11. If you responded ‘yes’ to any option, please proceed 
to question 2. 
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2. Teachers use all kinds of information (i.e., data) to help plan for instruction that meets student learning needs. 
How frequently do your teachers use the following forms of data? 
Less than once a Once ortwicea Weekly or A few times a 


Do not use month month almost weekly week 
NSCAS-English Language Arts () () () () () 
NSCAS-Mathematics () () () () () 
NSCAS-Science 
NSCAS-ACT 


MAP Growth (NWEA) 

Formative Assessments 

Perceptual Data (i.e., perceptions of 
é () () () () () 

learning environment) 


Other: () () () () () 


() () () () () 
() () () () () 
ELPA21 () () () () () 
() () () () () 
() () () () () 
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3. Now, how useful are the following forms of data to teachers’ practice? 


Not Somewhat Very 
useful useful Useful useful 
NSCAS-English Language Arts () () () 
NSCAS-Mathematics 
NSCAS-Science 
NSCAS-ACT 
ELPA21 


MAP Growth (NWEA) 
Formative Assessments 
Perceptual Data (i.e., perceptions of learning environment) 


( 
( 
( 
( 
( 
( 
( 
( 
Other: ( 


~orrea roads 
~~ HS YS YS YS YS 
~~ YS YH YS YS YS YS 


) 
) 
) 
) 
) 
) 
) 
) 


) 
) 
) 
) 
) 
) 
) 
) 


If you indicated that NSCAS-English Language Arts is “not available” to you in question 1, OR if you indicated that you “do 
not use” NSCAS-English Language Arts in question 2, please go to question 5. 


4. These questions ask about NSCAS-English Language Arts. In a typical school year, how often do your teachers do 
the following? 
One or two A few times a 


times a year year Monthly Weekly 

a. UseNSCAS-EnglishLanguage Arts to identify instructional 

content to use in class. () () () () 
b. Use NSCAS-English Language Arts to tailor instruction to 

individual students’ needs. () () () () 
c. Use NSCAS-English Language Arts to develop 

recommendations for additional instructional support. () () () () 
d. Use NSCAS-English Language Arts to form small groups of 

students for targeted instruction. () () () () 
e. Discuss NSCAS-EnglishLanguage Arts witha parent or 

aiaralan. () () () () 
f. Discuss NSCAS-English Language Arts witha student. () () () () 


g. Meet with a specialist (e.g., instructional coach or data coach) 
about NSCAS-English Language Arts. 

h. Meet with another teacher about NSCAS- English Language 
Arts. 


() () () () 
() () () () 


If you indicated that NSCAS-Mathematics is “not available” to you in question 1, OR if you indicated that you “do not use” 
NSCAS-Mathematics in question 2, please go to question 6. 
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5. These questions ask about NSCAS-Mathematics. In a typical school year, how often do your teachers do the 


following? 


Use NSCAS-Mathematicstoidentify instructional content to 
use inclass. 

Use NSCAS-Mathematics to tailor instruction to individual 
students’ needs. 

Use NSCAS-Mathematics to develop recommendationsfor 
additionalinstructional support. 

Use NSCAS-Mathematics to form small groups of students for 
targeted instruction. 

Discuss NSCAS-Mathematics with a parent or guardian. 
Discuss NSCAS-Mathematics with a student. 

Meet with a specialist (e.q., instructional coach or data 
coach) about NSCAS-Mathematics. 

Meet with another teacher about NSCAS- Mathematics. 


One ortwo A fewtimesa 
times a year year 


() () 
() () 
() () 
() () 


() () 


Monthly 
() 


() 
() 
() 


() 


Weekly 


If you indicated that NSCAS-Science is “not available” to you in question 1, OR if you indicated that you “do not use” NSCAS- 
Science in question 2, please go to question 7. 


6. These questions ask about NSCAS-Science. In a typical school year, how often do your teachers do the following? 


UseNSCAS-Scienceto identify instructional content to use in 
class. 


Use NSCAS-Science to tailor instruction to individual students’ 


needs. 

Use NSCAS-Science to develop recommendationsforadditional 
instructional support. 

Use NSCAS-Science to form small groups of students for 
targeted instruction. 

Discuss NSCAS-Science with a parent or guardian. 

Discuss NSCAS-Science with a student. 

Meet with a specialist (e.g., instructional coach or data coach) 
about NSCAS-Science. 

Meet with another teacher about NSCAS- Science. 


One ortwo Afewtimesa 
times a year year 


Monthly 


Weekly 


If you indicated that NSCAS-ACT is “not available” to you in question 1, OR if you indicated that you “do not use” NSCAS- 
ACT in question 2, please go to question 8. 


fe3) 


7. These questions ask about NSCAS-ACT. In a typical school year, how often do your teachers do the following? 


Use NSCAS-ACT toidentify instructional content to use in class. 
Use NSCAS-ACT to tailor instruction to individual students’ 
needs. 

Use NSCAS-ACT to develop recommendations for additional 
instructional support. 

Use NSCAS-ACT to form small groups of students for targeted 
instruction. 

Discuss NSCAS-ACT with a parent or guardian. 

Discuss NSCAS-ACT with a student. 

Meet with a specialist (e.g., instructional coach or data coach) 
about NSCAS-ACT. 

Meet with another teacher about NSCAS-ACT. 
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One ortwo Afewtimesa 
times a year year 


() () 


Monthly 
() 


Weekly 
() 


If you indicated that ELPA21 is “not available” to you in question 1, OR if you indicated that you “do not use” ELPA21 in 
question 2, please go to question 9. 


8. These questions ask about ELPA21. In a typical school year, how often do your teachers do the following? 
One ortwo Afewtimesa 


times a year year Monthly Weekly 

a. Use ELPA21 to identify instructional content to use in class. () () () () 
b. Use ELPA21 to tailor instruction to individual students’ needs. () () () () 

Use ELPA21 to develop recommendations for additional 

instructional support. () () () () 
d. Use ELPA21 to form small groups of students for targeted 

instruction. () () () () 
e. Discuss ELPA21 with a parent or guardian. () () () () 
f. Discuss ELPA21 with a student. 
g. Meet with a specialist (e.g., instructional coach or data coach) 

about ELPA21. () () () () 
h. Meet with another teacher about ELPA21. () () () () 


If you indicated that MAP Growth (NWEA) is “not available” to you in question 1, OR if you indicated that you “do not use” 
MAP Growth (NWEA) in question 2, please go to question 10. 


9. These questions ask about MAP Growth (NWEA) used in your school or district. In a typical month, how often do 
your teachers do the following? 
Lessthan Onceortwice Weeklyor Afewtimesa 
onceamonth amonth almost weekly week 

a. Use MAP Growth (NWEA) to identify instructional content to 
use in class. 

b. Use MAP Growth (NWEA) to tailor instruction to individual 
students’ needs. 

c. Use MAP Growth (NWEA) to develop recommendations for 
additional instructional support. 

d. Use MAP Growth (NWEA) to form small groups of students 
for targeted instruction. 

e. Discuss MAP Growth (NWEA) with a parent or guardian. () () () () 

f. Discuss MAP Growth (NWEA) with a student. () () () () 

g. Meet with a specialist (e.g., instructional coach or data coach) 
about MAP Growth (NWEA). 

h. Meet with another teacher about MAP Growth (NWEA). () () () () 


If you indicated that Formative Assessments are “not available” to you in question 1, OR if you indicated that you “do not 
use” Formative Assessments in question 2, please go to question 11. 


REL 2021-054 E-11 


10. These questions ask about Formative Assessments developed and used in your school or district. In a typical 
month, how often do your teachers do the following? 
Lessthan Onceortwice Weeklyor Afewtimesa 
onceamonth amonth almost weekly week 
a. Use Formative Assessments to identify instructional content 
to use in class. 
b. Use Formative Assessments to tailor instruction to individual 
students’ needs. 
c. Use Formative Assessments to develop recommendations for 
additional instructional support. 
d. Use Formative Assessments to form small groups of students 
for targeted instruction. 
e. Discuss Formative Assessments with a parent or guardian. () () () () 
f. Discuss Formative Assessments with a student. () () () () 
g. Meetwithaspecialist (e.g., instructional coach or data coach) 
about Formative Assessments. 
h. Meet with another teacher about Formative Assessments. () () () () 


The remainder of this survey asks general questions about the use of data to inform your education practice. For the rest of 
this survey, please consider only the following when you are asked about "data": 


NSCAS-English Language Arts 
NSCAS-Mathematics 
NSCAS-Science 

NSCAS-ACT 

ELPA21 

MAP Growth (NWEA) 
Formative assessments 


11. These questions ask about supports for using data. Please indicate how much you agree or disagree with the 
following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
a. My teachers are adequately supported in the effective use of 
ree () () () () 
b. Myteachers are adequately prepared to use the data. () () () () 
There is someone who answers my teachers’ questions about () () () () 
using data. 


d. There is someone who helps my teachers change their 
practice (e.g., their teaching) based on data. 

e. My district provides my teachers enough professional 
development about datause. 

f. My district’s professional development for my teachers is 
useful for learning about data use. 
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12. These questions ask about your attitudes and opinions regarding data. Please indicate how much you agree or 
disagree with the following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
a. Data help teachers plan instruction. () () () () 
b. Data offer information about students that was not already 
eae () () () () 
c. Data help teachers know what concepts students are 
igarning: () () () () 
d. Data help teachers identify learning goals for students. () () () () 
e. Students benefit whenteacher instruction is informed by data. () () () () 
f. | think itis important to use data to inform education practice. () () () () 
g. like to use data. () () () () 
h. | find data useful. () () () () 
i. () () () () 


Using data helps me be a better educator. 


13. These questions ask about teacher supports for using data. Please indicate how much you agree or disagree with 
the following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
| encourage data use as a tool to support effective teaching. () () 


| create many opportunities for teachers to use data. ( () 
| have made sure teachers have plenty of training for data use. ( 
| am a good example of an effective data user. ( 

( 

( 


| discuss data with my teachers. 
| create protected time for using data. 
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) 
) 
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14. Your school or district gives you programs, systems, and other technology to help you access and use student data. 
The following questions ask about these computer systems. Please indicate how much you agree or disagree with 
the following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
a. |have the proper technology to efficiently examine data. () () () () 
b. The computer systems in my district provide me access to lots 
eh dais () () () () 
c. The computer systems (for data use) in my district are easy to 
ieee () () () () 
d. Thecomputer systems in my district allow me to examine 
various types of data at once (e.g., attendance, achievement, () () () () 


demographics). 
e. The computer systems in my district generate displays (e.g., () () () () 
reports, graphs, tables) that are useful to me. 
15. These questions ask about your attitudes towards your teachers’ use of data. Please indicate how much you agree 
or disagree with the following statements: 


Strongly Strongly 
disagree Disagree Agree agree 
a. My teachers are good at using data to diagnose student learning needs. () () () () 
b. My teachers are good at adjusting instruction based on data. () () () () 
c. Myteachers are good at using data to plan lessons. () () () () 
d. My teachers are good at using data to set student learning goals. () () () () 


16. What else would you like to share with us about data use? 


For more information about this survey, please contact: NDE.Research@nebraska.gov 
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